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Abstract 



We present a uniform non-monotonic solution to the problems of reasoning about action 
on the basis of an argumentation-theoretic approach. Our theory is provably correct relative 
to a sensible minimisation policy introduced on top of a temporal propositional logic. 
Sophisticated problem domains can be formalised in our framework. As much attention of 
researchers in the field has been paid to the traditional and basic problems in reasoning 
about actions such as the frame, the qualification and the ramification problems, approaches 
to these problems within our formalisation lie at heart of the expositions presented in this 
paper. 

1. Motivation and Introduction 

The need for a good reasoning about action formalism is apparent for research in artificial 
intelligence (AI). Alongside the logicist point of view to artificial intelligence, more recently, 
there emerges the cognitivist and situated action-based approaches (see Kushmerick, 1996 
and the references therein). The latter approaches provide some immediate and practical 
answers to certain issues of AI. The current problem domains for (Soccer) Robot Cup 
seem to be an area where these approaches promise to gain fruitful results. On the other 
hand, the logicist approach aims at long term solutions for the general problems of AI. 
From a logicist approach, formalising dynamic domains for reasoning about action can 
be realised within a logical knowledge representation. The general idea is that intelligent 
agents should be able to represent all kinds of knowledge in a uniform way such that some 
general problem solver can fully employ and find a solution based on their knowledge. As 
it turns out, there are difficulties with such a general approach to AI. Consider the task of 
formalising dynamic domains in some logical language. To formalise the dynamics of an 
action (or event) in a language with n fluents 1 , one will need to axiomatise not only about 
the fluents that are effected by the action but also about those that are not. Essentially, it 
requires that n axioms be asserted. Such a formalisation can hardly be considered a good 

1. fluent is a technical term referring to functions or predicates whose values can be varied relative to time. 
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representation. Hence, there is the need to solve this problem in logic-based reasoning about 
action formalisms. This is the well known frame problem as introduced by McCarthy and 
Hayes (1969). Moreover, there is still a problem in axiomatising the effects of an action, 
called the effect axioms. A logical axiomatisation requires that the conditions under which 
the effects will take place after executing the action be precisely specified. However, there 
are potentially infinitely many such conditions, some of which the reasoner may never have 
thought about. No realistic formalisation would ever be able to exhaustively enumerate all 
of those conditions. Nonetheless, to start a car, most people only worry about whether they 
have the key to that car. They never bother checking whether there is something blocking 
the tailpipe or checking all electric circuits to make sure that they are all well connected. 
Such a story has long been well-known within the community of commonsense reasoning, 
in particular reasoning about action. This is known as the qualification problem and was 
introduced by McCarthy (1977). 

While there have been a number of solutions to the frame problem (e.g., Shanahan, 1997; 
Reiter, 1991; Castilho, Gasquet, & Herzig, 1999), the qualification problem has largely been 
ignored with the notable exception of Thielscher's (2001) solution within the Fluent Cal- 
culus and Doherty and Kvarnstrom's (1998) circumscription-based solution using fluent 
dependency constraints. Some people argue that the frame problem is already very chal- 
lenging and it would be a good approach to thoroughly solve the frame problem before 
complicating a formalism with the qualification problem. We argue that there is a danger 
of approaching these problems from that point of view for (at least) two reasons: 

1. It may be very hard to come up with a uniform solution for all problems: while many 
existing solutions for the frame problem are monotonic (e.g., Reiter, 1991; Castilho 
et al., 1999), the qualification problem inherently requires a non-monotonic solution. 
This is the case with the original qualification problem as stated by McCarthy (1977) 
for the dynamics of actions/events need to be finitely axiomatisable and when an 
unexpected qualification for an action arises, the agent must necessarily retract his 
initial expectation that the effects caused by the action would take place, making the 
underlying reasoning machinery non-monotonic (see section 1.2 for a discussion on 
the qualification problem). 

2. Many solutions to the frame problem can only succeed under some precise assumptions. 
For instance, 

• Actions always succeed. This is the action omniscience assumption. More pre- 
cisely, this assumption dictates that the qualification problem is skipped. This 
is the case with all monotonic solutions to the frame problem. 2 

• Fluents change if and only if the reasoner knows that there exists an action 
that possibly changes its value. This can be termed as domain omniscience 

2. The argument that any solution to the frame problem which works with nondeterministic action is not 
subject to this assumption does not stand. The quick fix of allowing such an approach to a fortiori express 
actions that may fail by representing failure as a possible effect is an invalid one. It is because we can 
no longer infer that, in the absence of evidences that suggest otherwise, actions would normally succeed. 
It's also worth noting that Lin's (1996) extension of Reiter's (1991) solution to the frame problem in the 
Situation Calculus to deal with nondeterministic action is based on circumscription. 
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assumption. It assumes that the reasoner has complete (ontological) knowledge 
of the domain about which he is reasoning. 

The above two reasons are of course closely related as the former arises due to the 
underlying assumptions in the latter which no longer holds once the qualification problem 
is taken into consideration. 

In the remainder of this section, we review several works on this topic before introducing 
the reader to our approach. 

1.1 The Frame Problem 

In the late 1960s, the frame problem had been recognised as a major obstacle to formalising 
dynamic domains (see the discussions and exposition by McCarthy & Hayes, 1969; Green, 
1969). Several alternative responses to the frame problem have been proposed along way. 
To respond to the explosive number of axioms required for theorem proving-based planners 
as proposed by Green (1969), Fikes and Nilsson (1971) introduce procedures that operate 
on special data structures used to represent dynamic domains. However, for complex and 
sophisticated problem domains, e.g. those with domain constraints, concurrent actions, 
observations at different time points, etc. STRIPS quite often fails to express the domain 
knowledge. In fact, the expressivity of STRIPS is quite limited as has been pointed out 
by Lifschitz (1987). Another response attributing the frame problem as an artefact of 
the situation calculus has proved to be ungrounded. There are attempts to distinguish 
a logical or epistemological aspect of the frame problem from the computational aspect 
(e.g., McDermott, 1987; Kowalski, 1992). While the computational inefficiency associated 
with a representation of dynamic domains in the situation calculus can be attributed to 
the explosive number of global situations required by the situation calculus as argued by 
Kowalski and Sergot (1986), the logical aspect of the frame problem is inherent to any 
logic-based representation of dynamic domains. It is thus essential that a logical approach 
to AI and knowledge representation have a decent solution to the frame problem. 

Later, with the introduction of the qualification problem by McCarthy (1977), it is 
reckoned that formalising dynamic domains not only is about solving the frame problem 
but would require systematic studies to fundamental issues of knowledge representation. In 
the early 1980s, the frame and the qualification problem were considered to be instances 
of commonsense reasoning problems. In particular, many believed that a non-monotonic 
reasoning framework would solve the frame problem. It was argued that the 'principle of 
inertia' 3 which is considered to be the key to the frame problem can be formalised in terms 
of default rules or default axioms in default reasoning. Moreover, it was also argued that to 
solve the qualification problem, the following common sense law should be rendered: "an 
action, by default, would qualify to succeed and bring about the intended effects unless there 
is known reason for it not to, " in formalisations of dynamic domains. 

With the introduction of several non-monotonic reasoning formalisms, e.g. truth main- 
tenance systems (TMSs) by Doyle (1979), default logics by Reiter (1980), circumscriptive 
approaches by McCarthy (1980), modal non-monotonic logic by McDermott and Doyle 

3. The principle of inertia or the common sense law of inertia basically states that "By default a fluent 
is assumed to persist over time unless there is evidence to believe otherwise. " The reader is referred to 
Shanahan's (1997) book for more details on this principle and the issues around it. 
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(1980), autoepistemic logic by Moore (1985), etc., it was believed that these problems were 
solved. The solutions to these problems were illustrated as examples for the proposed non- 
monotonic reasoning frameworks. For instance, McCarthy (1986) showed how circumscrip- 
tion is used to solve the frame problem relative to the blocks world domain. Unfortunately, 
Hanks and McDermott (1987) show that these formalisations do not work correctly in a 
simple dynamic domain known as the Yale Shooting Problem (YSP). We will now review 
successful attempts to solve the frame problem: 

1. Baker (1989) successfully modifies the original (and incorrect) circumscription policy 
proposed by McCarthy (1986) to deal with the Yale Shooting Problem. In the tradi- 
tional circumscriptive policy, the predicate Abnormal is minimised with the predicate 
Holds allowed to vary. Baker suggests that, instead of allowing Holds to vary, the 
function Result should be the one to be varied. While this does not solve the frame 
problem in its full generality, this initiates the line of research which brings many 
fruitful results to reasoning about action community. For a more detailed discussion 
about these solutions and the follow up works, the reader is referred to Shanahan's 
(1997) book. Furthermore, Foo, Zhang, Vo, and Peppas (2001) present an exposi- 
tion on the issue from an automata and system theory point of view. In order for 
Baker's (1989) solution to work correctly, additional axioms need to be introduced, 
e.g. domain closure axioms, axioms about the existence of situations, etc. This em- 
phasises that: (i) the circumscriptive approach to reasoning about action only works 
under careful designation and considerations of the domain; and more importantly, 
(ii) circumscription is domain dependent. That is, a domain dependent circumscrip- 
tive policy is required to correctly render the common sense of a particular problem 
domain. 

2. A number of researchers argue that in many cases, a monotonic solution to the frame 
problem will be sufficient. Pednault (1989) assumes that the effect of actions on fluents 
are specified by effect axioms of the following forms: 

e+(x,y,s)D F(x,do(A(y),s)), (1) 
e F (x,y,s) D ^F{x,do{A(y),s)), (2) 

Here, A(y) and F(x, s) are the parameterised action and fluent, respectively; £p(x, y, s) 
and £ F (x, y, s) are first order formulas whose free variables are among x,y,s. Pednault 
(1989) makes the following Causal Completeness Assumption: 

The axioms (1) and (2) specify all the causal laws relating the action A 
and the fluent F . 

Note that the Causal Completeness Assumption is a stronger form of the domain 
omniscience assumption presented above. Under this assumption, the following frame 
axioms can be introduced: 

F(x,s) A ^e F (x,y,s) D F(x,do(A(y),s)). 
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and 

->F(x, s) A y, s) D do(A(y), s)). 

Schubert (1990), elaborating on a proposal of Haas (1987), employs the so-called 
Explanation Closure Axioms of the following forms: 

F(x, s) A ->F(x, do(A, s)) D a F (x, A, s), (3) 
->F(x, s) A F(x, do(A, s)) D /?f0?, A, s), (4) 

Or, equivalently, we can rewrite the above two axioms as follows: 
F(x, s) A ->atF(x, A, s) D F(x, do(A, s)). 

and 

s) A ->/3f{x, A, s) D ->F(x, do(A, s)). 

Schubert's proposal is correct under the following assumption, called the Explana- 
tion Closure Assumption: 

of completely characterises all those actions A that can cause the fluent 
F's truth value to change from true to false; similarly for (3p- 

Reiter (1991) then combines the merits of the above two proposals by systematically 
generating the frame axioms as proposed by Pednault (1989) with the quantifiers over 
the set of actions as proposed by Haas (1987) and Schubert (1990). 

Other researchers who also propose monotonic solution to the frame problem include 
Castilho et al. (1999), and Zhang and Foo (2002). 

3. Attempts to solve the frame problem using default logic (Reiter, 1980) also encounter 
some problematic issues. Hanks and McDermott (1987) show that a natural formu- 
lation of the Yale Shooting Problem in default logic suffers the same problem as that 
with circumscriptive approaches, viz. the existence of anomalous extensions. Morris 
(1988) proposes a slight modification on Hanks and McDermott's original formulation 
to the Yale Shooting Problem in an attempt to avoid the anomalous extensions. As 
pointed out by Turner (1997), Morris' formulation is complete, and thus eliminates the 
anomalous extensions in the Yale Shooting Problem, but unsound. More importantly, 
from Morris' formulation it is not clear how dynamic domains should be formulated 
in general. Turner (1997) himself then proposes a way to formalise dynamic domains 
using default logic (and also logic programming). His solution is based on the fol- 
lowing observation: In the Yale Shooting domain and similar dynamic domains, the 
anomalous extensions arise because undesired effects of an action can be derived by 
reasoning "backward in time." For instance, in the Yale Shooting domain, by making 
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the counterintuitive supposition that the victim of the shooting is somehow still alive 
after the shooting, an anomalous extension come up in the following way. First, it 
allows the default saying that the victim persists to be alive regarding the shooting 
action to be applicable. As a consequence, the gun must not be loaded before the 
shooting action. Therefore, it blocks the application of the default saying that the 
gun persists to be loaded regarding the waiting action. In other words, the loaded 
gun would get unloaded (magically) during the waiting action which is an undesir- 
able conclusion. To block these lines of "backward" reasoning, Turner appeals to the 
non-contrapositivity of inference rules and replaces the implications by inference rules. 
To guarantee that this formulation work correctly, additional techniques are required 
such as a fact ip will be formulated as an inference rule: 



and enforcing the completeness of the initial situation by adding the following rules: 



for every fluent /. 

However, Turner's (1997) formulation is still fairly ad hoc as different techniques are 
added to fix the known issues. For example, the inference rules are used in place of 
implications to block the application of the undesirable "backward" reasoning, the 
rules completing the initial situations are added to overcome the unsoundness issue in 
Morris' (1988) formulation, etc. This also shows the problematic side of default logic as 
a uniform formalisation to various problems of common sense reasoning. This becomes 
a serious issue if one proceeds with the question of how the qualification problem, a 
typical problem of default reasoning, is solved in Turner's (1997) formalisation of 
dynamic domains. This is the case, for example, when instead of asserting that the 
victim dies whenever it is shot by a loaded gun the reasoner can only maintain that as 
a default proposition as there may be many hidden possible conditions under which 
the victim may not die. Thus the reasoner is able to deal with 'surprising' situations 
in which the victim is observed to be still alive after the shooting action (of a loaded 
gun). Another, symmetric, case is with 'surprises' regarding the persistence of fluents. 
For instance, after a waiting action, which is not supposed to unload a gun, the gun, 
which was loaded before the wait action, is observed to be unloaded. Such a scenario 
was first introduced by Kautz (1986) in a scenario called the Stolen Car Problem. 
In both cases, reasoning "backward in time" is necessary. It is not clear how these 
will be rendered in Turner's formulation which explicitly intends to block "backward" 
reasoning. These scenarios will be analysed in the solution we present later in this 
paper. 

1.2 The Qualification Problem 

While there have been several solutions to the qualification problem, none of these addressed 
the original qualification problem introduced by McCarthy (1977) and later formalised by 
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Ginsberg and Smith (1988). 
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1. Lin and Reiter (1994) propose a formalisation for action theories in the situation cal- 
culus (SC). Their formalism is an extension of Reiter's (1991) solution to the frame 
problem (sometimes) by incorporating state constraints. They discover that there are 
at least two different kinds of state constraints which they call ramification and quali- 
fication constraints. They then go further to claim a solution to the qualification (and 
the ramification) problem. The basic idea behind their solution to the qualification 
problem is that certain state constraints imply implicit preconditions of some actions. 
Thus an action may not be qualified even though it appears (from the explicit action 
description) to be. While this is of course a special case of the qualification prob- 
lem, the classical qualification problem as introduced by McCarthy (1977) has a much 
broader extent. In this setting, the qualification problem is more a pragmatic issue 
than a technical issue. Similar to the frame problem, it is impractical, and sometimes 
impossible, to axiomatise all the possible preconditions of an action. For example, in 
addition to the requirement that the gun be loaded, to guarantee that performing the 
action shoot would kill the victim, many preconditions must also be included such as: 
the gun is not malfunctioning, the shooter does not miss the victim, the victim does 
not wear a bullet-proof jacket, etc. among which some may be very improbable such 
as: "no alien interferes with the bullet." The reasoner simply does not want to con- 
sider these conditions by assuming that they are not the case unless there are explicit 
evidences stating otherwise. In other words, the qualification problem in its original 
form requires that the reasoner be able to tolerate the mistaken conclusions possibly 
jumped to by previous inferences and to correct them appropriately. Henceforth, we 
will always refer to the qualification problem in this original form. It is this similarity 
to the frame problem that led John McCarthy to conjecture that: 

The frame problem may be a sub-case of what we call the qualification 
problem, and a good solution of the qualification problem may solve the 
frame problem also. 

(McCarthy, 1977, p. 1040, italics are original.) 

Roughly 10 years after his introduction of the qualification problem, McCarthy (1986) 
presented his solution to the problem using his non-monotonic formalism of circum- 
scription. However, this solution suffers an almost identical flaw as its counterpart 
regarding the frame problem: simple minimisation of abnormalities sanctions anoma- 
lous models (e.g., Thielscher, 2001). 

2. McCain and Turner (1995) propose a solution to the problem described by Lin and 
Reiter (1994), viz. the problem of deriving the implicit preconditions from state 
constraints. McCain and Turner's solution is posed in a model-based representation 
of action theories. 

3. Similar to McCain and Turner's (1995) result, Baral (1995) offers a solution to the 
problem defined by Lin and Reiter using a state-based representation. Baral extends 
the language of disjunctive logic programs for state specification and as an action 
description language. 
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4. Doherty and Kvarnstrom (1998) make a careful investigation to the qualification prob- 
lem. They are aware of the shortcomings present in the definition of the "qualification 
problem" introduced by Lin and Reiter (1994). They proceed one step further to dis- 
tinguish between the weak and strong forms of the qualification problem. To deal 
comprehensively with the qualification problem in its full extent, Doherty and Kvarn- 
strom apply circumscription on a predicate which plays a similar role to the predicate 
Poss used by Lin and Reiter (1994). 

Even though Doherty and Kvarnstrom's (1998) solution is closest in spirit to the 
original form of the qualification problem, there is still a serious problem with their 
approach. The intended designation on predicate Poss and its variants is action- 
oriented. That is, it would qualify on the executability condition for the action under 
consideration, not towards the effects that action is supposed to cause. In other 
words, only circumscribing Poss does not guarantee to capture the full extent of 
the qualification problem. For example, a single action of shooting a gun may cause 
several effects: killing the victim, making a loud noise, emptying the cartridge, etc. 
The conditions for such an action to be executable is: having the gun, the gun is not 
broken, the gun is loadable, etc. Once the action is executable, it is not necessary 
that all effects will take place. It may be the case that there is a loud noise and the 
cartridge is emptied but the victim is still alive since the victim was wearing a bullet- 
proof jacket. Assuming that the reasoner is somehow aware about this possibility, 
should he include the requirement that the victim not wear a bullet-proof jacket as a 
qualification for the action shoot? Perhaps he should not for he would still expect to 
hear a loud noise and the cartridge to be emptied after the shoot action. 

These are not the end of all the troubles though. The presence of both qualification 
and ramification constraints causes several complications. Firstly, they are not syntac- 
tically distinguishable. Secondly, as has been mentioned by Doherty and Kvarnstrom 
(1998), qualification constraints may cause indirect effects to arise and vice versa, i.e. 
ramification constraints may reveal implicit action preconditions. 

Remark: The terms ramification constraints and qualification constraints were first 
introduced by Lin and Reiter (1994) when a careful examination to state constraints 
was taken. As discussed by Doherty and Kvarnstrom (1998), these two kinds of con- 
straints might interact in several ways. Consider the example introduced by Doherty 
and Kvarnstrom (1998): the only preconditions of the action board a plane are having- 
ticket and at-gate. However, to a passenger who places a gun into his pocket at home 
before travelling to the airport and proceeding to the gate, a new qualification for 
the action board materialises. Because one ramification of putting an object in your 
pocket is that it will stay with you as you travel from location to location (i.e. result of 
a ramification constraint), a reasoner could easily conjecture that our passenger fails 
to board the plane. On the other hand, the fact that a passenger who possesses a gun 
when trying to board the plane must fail to board the plane is a result of a qualification 
constraint. Now, not only the fact that a passenger possesses a gun disqualifies the 
action of boarding a plane but it also brings about an indirect effect when the action 
of boarding a plane is executed: the passenger being put under arrest. Note that for 
this indirect effect to take place, both requirements must be present: the action of 
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boarding a plane being executed, and the above qualification constraint is present. In 
other words, a qualification constraint might also bring about indirect effects. 

We believe that all these problems are too sophisticated for any circumscription pol- 
icy to successfully address in most situations. Furthermore, such a policy would be 
extremely hard to understand and error-prone. Recall the failure of non-monotonic 
reasoning formalisms regarding the frame problem (in its simplest form viz. without 
the ramification and the qualification problems). Researchers had failed to point out 
this bug for several years before Hanks and McDermott discovered it in their award 
winning paper (1987). 

5. More recently, Thielscher (2001) gives an exposition on the qualification problem. 
Thielscher discusses the problem sustained by McCarthy's (1986) simplistic circum- 
scription policy, viz. the anomalous models. He then introduces a default logic based 
formalisation for the qualification problem in the Fluent Calculus and shows that 
his formalisation does not suffer the problem of anomalous models. Note that in 
Thielscher's formalisation, circumscription is still required to generate the initial the- 
ories of the default theories (in addition to the set of default rules). Nevertheless, 
Thielscher's solution still suffers the following drawbacks: (i) Thielscher's use of the 
predicate Poss is in the same way as has been formulated by Doherty and Kvarnstrom 
(1998). Thus, qualifications are taken over the executability conditions for the actions 
rather than over different effects of the actions; and (ii) while Thielscher shows that 
the problem of anomalous models sustained by McCarthy's (1986) circumscription 
policy is overcome in his formalisation, it's not entirely clear whether Thielscher's 
formalisation which is based on both circumscription and default logic will not suffer 
from other anomalies. 

1.3 The Ramification Problem 

In the context of reasoning about action, the ramification problem is mainly related to 
indirect effects. Finding a solution to this problem may not be easy as indirect effects 
indicate exceptions to frame assumptions and require special treatment. While there have 
been several formalisms dealing with the ramification problem, e.g., see (Lin, 1995; McCain 
& Turner, 1995; Thielscher, 1997), there are still several issues that need a more careful 
consideration. We consider three examples to motivate our discussion. 

Example 1 Consider Thielscher's (1997) circuit: 

This example is interesting because it gives a counterexample for the minimalistic ap- 
proaches e.g. in the work of McCain and Turner (1995). In this domain, the intended 
relationship between relay and SW2 is that when relay is on, it would make SW2 jump off. 
Thus, when sw\ and sw^ are both closed, su>2 can not be also closed as that is prevented 
by relay. However, there is certainly a duration (no matter how short it is) before SW2 
is forced to jump off by relay. In the state given in Figure 1, after performing the action 
of closing switch swi, two next states are equally possible: one in which detect is on, in 
another it is off. 4 Only the latter is sanctioned in a minimalistic account. Through this 

4. The reason for nondeterminism in this case is due to insufficiency of domain information: depending on 
the sensitivity of relay, light and detect, when light could get lit quickly and detect is very sensitive to 
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-swl 



sw2 



-relay 



-light 



sw3 




-detect 



Figure 1: Thielscher's circuit 



example, Thielscher pointed out the need for keeping track of the chains of applications of 
indirect effects. 

Thielscher (1997) proposes a way to remedy this problem by keeping track of the appli- 
cations of the domain constraints which are re-expressed in terms of causal relationships. 
Thus, given the above example, his formalism is able to arrive at a next state in which the 
detect is on. Following such chains of causal relationships, the dynamic system undergoes 
several intermediate states before arriving at the next state. □ 

In this paper, we proceed one step further from Thielscher's (1997) position by formally 
representing the intermediate states as possible states of the world. 5 We believe that an 
intelligent agent should be able to reason about these intermediate states even though 
they may not satisfy all domain constraints. This capability is especially important if the 
reasoner needs to explain certain observations about the world in a systematic way. We 
note that given an observation, there may be several chains of causal relationships that 
bring about that observation. 6 Unless intermediate states are explicitly represented and 
reasoned about, there is no way for an agent to have a full insight to the system in hand 
and certain information would be missing. 



Example 2 Consider Lin's (1995) spring-loaded suitcase with two latches. Let's assume 
that the latches can be toggled if the suitcase is closed. The following state constraint is 
supposed to apply in this domain: up(Latchi) A up(Latch,2) D open(Suitcase) . 

The question is: how does a robot close the above suitcase back after opening it? McCain 
and Turner (1997) also consider this problem and their answer is: 



detect any glimpse of light and relay is not sensitive enough to make the switch su>2 jump off quickly 
enough then detect will be on; otherwise it will stay off. 

5. Note that this point of view also corresponds to the traditional definition of states as snapshots of the 
world. 

6. For example, given detect is not on in the next state, it can be that either the light has never been bright 
or the light may have been bright but the detect is not sufficiently sensitive to detect its momentary 
brightness. 
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In general, when both latches are up, it is impossible to perform only the action 
of closing the suitcase; one must also concurrently toggle at least one of the 
latches. 

(McCain & Turner, 1997, p. 464, italic is original.) 

The problem now is how to represent the action of holding the suitcase closed such 
that it would overcome the above indirect effect caused by the loaded spring. This also 
suggests another kind of actions whose direct effects are to keep the world unchanged. 
These actions have usually been formalised by other researchers as fluents, e.g. holding. 
Our main objection to this approach is that agents also need to reason about these actions 
since they may also require certain preconditions such as the agent is strong enough to 
hold the object. Moreover, under certain (abnormal) circumstances, agents may also fail to 
perform such actions. That is, these actions are also subject to the qualification problem 
discussed in the previous subsection. □ 

Example 3 Consider the circuit in Figure 2: 7 



-relay 1 




-relay2 



Figure 2: A dynamic domain with a (potentially) infinite sequence of indirect effects 

It is quite obvious that after performing the action flipi whose direct effect is having sw\ 
closed, the following circular sequence of indirect effects will take place: {relay±, ~^relay<i\ — > 
->SW2 — » {->relayi,relay2} — ► sw2 — > {relayi,->relay2}. This sequence of course would 
potentially carry on the above sequence of indirect effects indefinitely unless sw\ is flipped 
open or some device stopped functioning correctly, e.g. when the battery is out of charge. 
In other words, this action domain requires some action to be inserted in between a series 
of on going indirect effects which can not be captured by the above representation. Note 
also that none of the causation-based representations proposed by Lin (1995), McCain and 
Turner (1995) or Thielscher (1997) is able to deal with the above action domain. □ 

1.4 Towards a Solution 

To address the problems discussed in the previous sections, we argue that in order to find a 
uniform solution to these problems one should avoid cryptic formalisms whose consequences 

7. This example is an instance of the so-called "vicious cycles" scenarios, e.g., see (Shanahan, 1999). 
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can not be seen clearly from the formalisation of the problem domains. As a consequence, 
we propose a uniform non-monotonic solution to the main problems of reasoning about ac- 
tion. Essentially, when performing commonsense reasoning, the reasoner relies on a number 
of plausible assumptions, e.g., assuming that an instance of birds flies, or assuming that 
shooting a turkey with a loaded gun causes it to die, etc. In traditional default reasoning 
formalisms such as circumscriptive approaches or default logic, these assumptions are made 
implicit. For example, these are the instances of predicates which are minimised away by 
circumscription or the implicitly asserted justifications in default rules when they are still 
consistent with the extension under consideration in default logic. The proposed represen- 
tation formalism aims at making these assumptions explicit so that an automated reasoner 
is conscious (at least) about what assumptions it relies on when performing reasoning. 
Then the reasoner can always manipulate these assumptions independently of each other. 
It is also the basic idea of assumption-based frameworks which are at heart of Bondarenko, 
Dung, Kowalski, and Toni's (1997) argumentation-theoretic approach. 

We then proceed to consider the ramification problems and domain theories with concur- 
rent and non-deterministic events. Among the major results, we show that our framework 
captures the essence of the causation-based approaches regarding the ramification problem. 
Moreover, we also show the expressiveness of our formalism through two examples in which 
indirect effects also need qualifications and infinite sequence of indirect effects. To the best 
of our knowledge, none of the existing formalisms are able to cope with these scenarios. 

Based on the basic idea of assumption-based frameworks, our approach comprises the 
following major aspects of representation: 

1. We introduce different types of assumptions to render various laws of common sense 
in dynamic domains. For instance, frame assumptions are introduced to capture 
the common sense law of inertia whilst (two types of) qualification assumptions are 
introduced to overcome the qualification problem. 

2. We introduce a special class of (system-generated) dummy actions to allow the ex- 
planation problem, i.e. when some actions or events occur outside of the reasoner's 
knowledge, to be dealt with in a uniform manner. 

3. Being based on Bondarenko et al.'s (1997) argumentation-theoretic framework, our 
approach makes use of the inference rules to represent domain knowledge. 

4. Lying at heart of our approach is an argumentation-theoretic semantics, called plausi- 
bility semantics, which is argued to best render common sense knowledge in dynamic 
domains. This semantics consists in a particular policy of resolving conflicting as- 
sumptions when computing the argumentation to be accepted. 

To summarise, in this paper we formalise an expressive representation scheme in order 
to cope with sophisticated action domains. We believe that such a formalisation sometimes 
requires certain advanced knowledge to be encoded in a precise and well-engineered way. 
The representation of action theories proposed in this paper can be considered as the in- 
termediate level between commonsense and scientific knowledge. The expressiveness of the 
formalism is improved through several independent steps by adding further assumptions 
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into the domain descriptions. This also shows one advantage of our solution: a simple rep- 
resentation can be achieved by simply removing the involved assumptions. This is arguably 
a desirable feature as the reasoner has the option of either increasing the expressibility of the 
representation formalism or improving the simplicity and, as a consequence, the efficiency 
of the reasoning system. 

The rest of the paper is organised as follows: Section 2 summarises relevant features of 
the abstract argumentation framework proposed by Bondarenko et al. (1997), its seman- 
tics and concrete instances. In Section 3 we present the syntax and semantics of the basic 
temporal logic and the extension for reasoning about action. In Section 4 we present our 
formalisation for reasoning about action based on the argumentation-theoretic approach 
introduced by Bondarenko et al. (1997). Our approach to reasoning about action, in par- 
ticular a uniform solution to the frame and the qualification problems, as well as the main 
results of the paper are presented in Section 5. In Section 6, we show how the proposed 
formalism is extended to deal with more complex dynamic domains, including those with 
concurrent and non-deterministic events, and indirect effects. Related work and future 
research directions are discussed in Section 7. We will defer most proofs of the results 
presented in the paper to the Appendix. 

This paper is an extended version of two earlier conference papers (Vo &, Foo, 2001, 
2002). The main differences are that in this version all proofs are included, lemmas that are 
used in the proofs of the theorems are introduced to help the reader more easily comprehend 
these results, and the presentation has been improved and extended with more examples of 
the various constructions. 

2. Defeasible Reasoning by Argumentation 

Let a deductive system (C,7Z) be given, where C is some formal language with countably 
many sentences and 1Z is a set of inference rules. Given a theory V C £ and a sentence 
a £ £, we write T \~^c,tz) a if there is a deduction from T whose last element is a. Th^^ (r) 
denotes the set {a £ £ \ T \~/c,TZ) a }- Since the language £ is generally kept fixed whereas 
the set of inference rules 1Z is likely to vary depending on the description of the domain, 
when there is no possible confusion we will abbreviate \~(c,Ti) an d Th^.n) as an d Thji, 
respectively. Thus the classical inference relation h can also be written as \~n c where TZc is 
the set of inference rules of classical propositional logic. Note also that every set of inference 
rules considered in this paper will be a super set of TZc- 

Given a deductive system (£, 7Z), an assumption-based framework with respect to {£, 7Z) 
consists of a theory T representing the current knowledge of the reasoner about the domain, 
an assumption base AB and a contrariness operator ~, i.e. given an assumption 5 £ AB, 5 
denotes the contrary of 5. 

Remark: The notion of the contrary of an assumption is intended to generalise the classical 
negation —i5. Note that in general assumptions may be constructed by special operators 
(e.g. negation-as-failure in the case of logic programming, or the modal operator L in the 
case of autoepistemic logic, Moore, 1985), thus the contrariness operator must also be suf- 
ficiently general. 
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The hardest part in reasoning with assumption-based frameworks is computing the set 
of assumptions to augment the given theory T. In an argumentation-theoretic approach, 
this is realised by the attack relation. To determine which assumptions to be accepted, 
assumptions are put together to form arguments. The assumptions behind the best argu- 
ments are considered to be acceptable. Several semantics for best arguments are presented 
by Bondarenko et al. (1997) based on the notions of attack: Given an assumption-based 
framework (r, AB~ ) and an assumption set A C AB: 

• A attacks an assumption 5 G AB iff 5 € Th(T U A). 

• A attacks an assumption set A' £ AB iff A attacks some assumption 5 £ A'. 

• A is closed iff A = AB n Th(Y U A). 

• A is conflict-free iff there does not exist any 5 £ AB such that T U A \~n 5, 5. 

Assumption-based frameworks in which assumption sets are always closed are referred 
to as flat. In a flat assumption-based framework, the conflict-free property of a set of 
assumptions A is equivalent to the property that A does not attack itself. The major 
argumentation-theoretic semantics defined by Bondarenko et al. (1997) for assumption- 
based frameworks include: 

• Stability semantics: an assumption set A C AB is stable iff 

1. A is closed, 

2. A does not attack itself, and 

3. A attacks each assumption 5 £ A. 

Bondarenko et al. (1997) show that the above stability semantics corresponds to the 
standard semantics of extensions of Theorist (Poole, 1988), minimal models of (many 
cases of) circumscription (McCarthy, 1980, 1986), extensions of Default Logic (Reiter, 
1980), stable expansions of Autoepistemic Logic (Moore, 1985), and stable models of 
logic programming. In other words, from a complexity-theoretic perspective, any 
approach based on the existing formalisms to default reasoning can be rendered in a 
corresponding assumption-based argumentation framework with no loss in terms of 
computational complexity. 

• Admissibility and Preferability semantics: Bondarenko et al. (1997) go further to 
extend these existing formalisms by generalising the semantics of admissible and pre- 
ferred arguments which were originally proposed for logic programming only. The 
new semantics are defined in terms of "admissible" and "preferred" sets of assump- 
tions/extensions. An assumption set A C AB is admissible iff 

1. A is closed, 

2. A does not attack itself, and 

3. for all closed sets of assumptions A' C AB if A' attacks A then A attacks A'. 
Maximal (with respect to set inclusion) admissible assumption sets are called preferred. 
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Throughout this paper assumptions are expressed in terms of usual propositions. Thus, 
we will replace the notion of contrariness ~~ in Bondarenko et al.'s (1997) system with the 
classical negation -i and omit it from the specification of assumption-based frameworks. 
That is, an assumption-based framework (T,AB) consists of a theory T C £, and the 
assumption base AB which contains the assumptions to be used in the reasoning. 

3. Domain Descriptions 

We introduce a propositional action description language based on a more comprehensive 
representation formalism proposed by Sandewall (1994). In particular, we extend Draken- 
gren and Bja reland's (1999) language so that it is possible to describe narratives in our 
framework. 

3.1 Syntax 

Following Sandewall (1994), the underlying representation of time is a {discrete) time struc- 
ture T = (T, <, + , — ) consisting of 

• a time domain T whose members are called time points which are integers in this 
paper (except in a later part of the paper where the distinction will be made explicit); 

• <, + , — are as usual for integers. 

Given a time structure T = (¥,<,+,—), a signature a with respect to T is a tuple 
= (T, T, A), where T is a set of countably infinitely many time-point variables, J 7 is a set 
of propositional fluent names, and A is a set of action names. Since the time structure T is 
fixed in the rest of this paper, T will be taken implicitly whenever a signature is introduced. 
We assume that all sets in a are countable. We denote T* = {[">]/ | / € J 7 }. 8 A member 
of F* is a fluent literal. Moreover, A = Aq U DA, where Aq is the set of domain dependent 
action names, called basic actions, e.g. load, shoot, etc. and T>A = {dai \ I £ J-*} is the set 
of dummy actions. As will be explained later in this paper, our solution to the problems 
of reasoning about action is based on the basic guideline of attributing changes to events. 
Given the reasoner's ignorance about certain events that bring about changes in the world, 
the dummy actions are to be used to make up for these gaps in the reasoner's belief state. 
That is why we need to associate the dummy actions with the fluent literals from F* . 

For each fluent literal I G J*, we introduce the following two symbols: AQi, and FAi: 

• AQi is associated with the assumed qualifications upon the preconditions of an action 
regarding the fluent literal I. Essentially, AQi when used in the description of the 
dynamics of an action a allows the reasoner to describe only the main preconditions 
of a (with regards to the fluent literal I) while leaving other possible (but less probable) 
qualifications to be rendered by a single assumption AQi. 

• FAi is associated with the frame assumptions regarding I. FAi, when coupled with 
a particular frame inference rule, allows the reasoner to infer that the fluent literal I 
continues to hold in future time points unless there is a reason that defeats FAi. 

8. The notation [-i] means that the formula following it may, or may not, be negated. 
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Given a set of fluent literals r C J 7 *, we denote FA r = {FA t \ I G F} and AQ r = 
{AQi \l€T}. 

A time-point expression is one of the following: 

• a member of T, 

• a time-point variable in T, 

• an expression formed from time-point expressions using + and — . For convenience, 
we will also write r + and r~ instead of r + 1 and r — 1, respectively. 

We denote the set of time-point expressions by T£. 

Definition 3.1 Let a signature a = (T,F,A) be given and r, v G T£, f G J 7 , a G A, 

R G {=,<}, ® G {A, V, — >, <->}. Define the basic (domain description) language A over a 
by: 

Ao ::= true | false | f | rRu | -1A0 | Ao <8> Ao | [t]Ao, 
A ::= A | [r, v]a \ ->A | A ® A 
and the assumption base AB by: 
AS = ABaq UAB F a, where 
ABaq = {[r, | r, t> G Tf and / G J 7 *}, and 

ABfa = {[r]FAi \ t eT£ and Z G JF*}. 

The domain description language Cd (over <r) is defined: Cd = A U ^16. 9 

[r, v]a means the action a has a duration corresponding to the interval [r, [r, f]^4Q/ 
means the fluent literal Z is assumed to be qualified to hold by the end of the interval [r, v\ . 
\t\FAi means the fluent literal I is assumed by default to persist from the time point r 
to the next, i.e. the principle of inertia. Notice the difference between [rjF^ and [r]?2 
for some fluent literals h,l2 G T* . [r]Z2 indicates that the fluent literal I2 holds at r while 
[rjFi^ indicates that the fact that the fluent literal l\ persists during the interval [r, r + ] 
is true. 

For example, in the blocks world domain, to say that block A is on block B at the time 
point 2, we write: [2]on(A, B); or, to say that an action pickup the block A occurs between 
time points t± + 3 and t^ — 1 and that the relation < holds between t\ + 5 and t2, we write 
[h +3,t 2 - l]pickup(A) A (ti + 5 < t 2 ). 

A formula that does not contain any connectives (i.e. A, V, — >, and [.]) is atomic. 

If 7 is atomic and rG T£, then the formulas 7, [r]7, -17, _, [r]7, and [r]->7 are literals. 

Let 7 be a formula. A fluent f £ J 7 occurs /ree in 7 iff it does not occur within the 
scope of a [r] expression in 7. r G T£ binds f in 7 if a formula [r]ip occurs as a subformula 
of 7, and / is free in ip. If no fluent occurs free in 7, 7 is closed. If 7 does not contain any 
occurrence of [r] for any r G T£, then 7 is propositional. 

9. It would be more precise to denote the domain description language over a by However, as the 
signature is usually clear from the context and in order to avoid the mention of a every time we have to 
formalise something with the domain description language, we choose to denote it by Cd- 
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3.2 Semantics 

Definition 3.2 Let a = (T, T, A) be a signature. A state over a is a function from T to 
the set {true, false} of truth values. A history over a is a function h from T to the set of 
states. A valuation is a function (ft from T£ to T. A narrative assignment is a function 77 from 
T x A x T to the set {true, false}. In addition, we define e q : T x AQjf* xT^ {true, false} 
and Ef : T x FAjr. — > {true, false}. An interpretation over <r is a tuple (/i, 0, 17, e q , £/) where 
/t is a history, is a valuation, 77 is a narrative assignment and £ g ,£/ are defined as above. 

Example 4 Consider Hanks and McDermott's (1987) Yale Shooting Problem (YSP) : 
There are three possible actions: load (the gun), wait, and shoot (the victim with the 
gun). Normally, waiting does not cause any change in the world, but shooting leads to the 
victim's death, provided that, of course, the gun is loaded. Assume that all three actions 
are performed, in the given order. 

We define the signature <t Y sp to be a tuple ({t, t\, £2, u±, ui, ■ ■ •}, {loaded, alive}, {load, 

wait, shoot}). Then the Yale Shooting problem can be formulated in the domain description 
language C YSP as the following theory: r YS p,o = {[OjaZiue, [0, l]load, [1, 2]wait, [2, 3]shoot}. 

The following two histories hi and hi are corresponding to the well-known models in 
the literature of reasoning about action: h\ to the intended model and hi to the anomalous 
model most frameworks would produce. 



hi 




Figure 3: The two histories for the YSP action description. 

Each oval in Figure 3 represents a state over c YSP . A narrative assignment complying 
with the above action description would map the three tuples (0,load, 1), (I, wait, 2), and 
(2, shoot, 3) to true and other tuples to false (relative to the assumption that 'normally, 
given any action and any time point, there is no instance of that action at that time point 
unless specified otherwise'). 

Definition 3.3 Let 7, 5 G A and / = (h,(ft,rj,£ g ,£f) an interpretation. Assume r, v G T£, 
f £ T, A £ A, R e {=,<}, I G J 7 *, <£> G {A,V,^,^}, and x & {true, false}. Define the 
truth value of 7 in / for a time point t G T, denoted 1(7, t) as follows: 
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I(y^ t) = X 

I([r,v]A,t)= v ^(r),A,^v)) 
I([r}FA l ,t) = e f (<P(r),FA l ) 
7(-. 7 ,*) = -.7( 7 ,t) 
7([r] 7 ,t) = 7( 7 ,0(r)) 



I(f,t) = h(t){f) 

I([T,v]AQ l ,t)=e q (<t>(T),AQ l ,<j>(v)) 
I(rRv,t) = <t>{T)R4>{v) 
7( 7 ® (5, t) = J( 7 ,*)® J($,t) 



Two formulas 7 and 5 are equivalent iff 7( 7 , i) = 1(5, t) for all 7 and t. An interpretation 
7 is a model of a set T C A of formulas, denoted 7 |= T, iff 7(7, t) = true for every t £ T 
and 7 G T. A formula 7 G A is entailed by a set T C A of formulas, denoted T |= 7, iff 7 is 
true in all models of T. 

Definition 3.4 Let I = (h,4>,r),e q ,£f) be an interpretation. 

1. The set Occ 1 = {(t, A,n) GTxixT r/(i, A, u) = true} is called action occurrence 
denotation of 7. 



£ The set FA 1 = {{t,FA t ) € T x FA^» | e f (t,FAi) = true} is called F A- denotation of 



5. The set AQ 1 = {(t,AQ h u) € T x AQjr, x T | e q (t,AQ h u) = true} is called ^Q- 
denotation of 7. 

4. Representing Dynamic Domains in the Argumentation-Theoretic 
Approach 

We now proceed to showing an assumption-based framework for representing dynamic do- 
mains. We subsequently introduce a uniform framework for solving the frame and the 
qualification problems based on the argumentation-theoretic approach. General solutions 
for the frame and the qualification problems can be obtained by computing plausible sets 
of assumptions which guarantee that extensions computed from these sets of assumptions 
will be consistent when the given theory is consistent. We now introduce some additional 
notations: Given an inference rule r € 7Z, we denote by prem(r) and cons(r) the premise 
and the consequence of rule r, respectively. 

Definition 4.1 A deductive system {£d,1Z) is well-defined iff for each subset 5 C 72., if 
the set UreS P rem { r ) is consistent then the set CONS(S) = {cons(r) | r G S} is also 
consistent. 

Henceforth, we will assume that deductive systems are well-defined. Being formalised 
in terms of the argumentation-theoretic approach, the representation requires an extended 
notion of consistency. 

Definition 4.2 Let {Cr),TZ) be a deductive system, 

(i) a set of sentences T ^ Co is 1Z- consistent iff T false; 

(ii) an assumption-based framework (T,AB) with respect to (Cjj, TZ) is consistent iff T is 
72-consistent. 



1. 
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Remark: Observe that even when (£d,1Z) is a well-defined deductive system, consistency 
is not equivalent to ^-consistency. For instance, let 1Z = { — }, the (logically) consistent 
theory T = {a, b} is not ^-consistent. 

Example 4 (continued) Returning to the Yale Shooting problem, the following inference 
rules describe the actions of this domain: 

[r, v]load 
[v]loaded A ->[T]FA^i oaded 

[t, v]shoot, \r\loaded 
^[v]alive A ->[T]FA aJive 

[rjloaded, [T]FAi oaded 
[T+]loaded 

[T]alive, [T]FA a i ive 
[r + ]alive 

-^[T]loaded, [T)FA^i oaded 
^[r + ]loaded 

-^[rjalive, [rjfA^nfae 
^[r + ]alive 

Rules (5) and (6) represent the descriptions of the actions load and shoot, respectively. 
Action wait does not cause any effect to the world, so there is no need to describe it. Other 
rules render the common sense law of inertia: "at any time point, a fluent literal presumably 
persists to the next time point. " 

Most argumentation-theoretic semantics, e.g. stability, admissibility, preferability, com- 
plete, well-founded semantics, etc. (Bondarenko et al., 1997) are based on the notion of 
attack. However, to reason about problem domains with incomplete information, especially 
action domains, this notion alone may not be sufficient as we may not always be able to 
construct explicit arguments to defeat unsound assumptions. For example, consider the 
Yale Shooting Problem: By observing that a turkey is shot with a loaded gun at time point 
1, the reasoner infers plausibly that the turkey is dead at time point 2 using the assumption 
that the action shoot is qualified to bring about the effect of killing the victim. However, 
at time point 2, the reasoner could observe that the turkey is still alive. Existing solutions 
to the frame problem, e.g. Reiter's (1991), Thielscher's (1997), Castilho et al.'s (1999), etc. 
fail to deal with such a surprise since they allow a contradiction to be derived. Observe that 
the reasoner does not have any explicit reason to defeat the above qualification assumption, 
i.e. she is not aware of any cause that prevents the application of this qualification assump- 
tion. She only knows that it is not acceptable in this case by common sense. To formalise 
such phenomena, we introduce the notion of rejected assumptions. 
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Definition 4.3 Given an assumption-based framework (T,AB), a set of assumptions A C 
AB rejects an assumption 6 € AB iff 

(a) A is conflict-free, and 

(b) A U {5} attacks itself. 

For instance, in example 4, the set of assumptions Ai = {[Oj-F^a^e, [ljFiaiioo [Ij-F^oaded} 
attacks the assumption \2\FA a u ve . w Moreover, relative to the given action description, any- 
set of assumptions attacks the assumption [0]FA^i oa d e d- On the other hand, the set of as- 
sumptions A 2 = {[0]FA aHve , [l]FA alive , [2]FA aUve } rejects the assumption [i\FA loaded but 
A2 does not attack it. 

Observation 1 Given an assumption-based framework (T, AB) and a conflict-free set of 
assumptions A C AB, if A attacks an assumption 5 ^ A then A rejects 6. 

Then, why do we not generalise the contrariness notion of an assumption so that it 
would be general enough to account for all rejected assumptions? The reason is because we 
want to isolate the set of assumptions that are rejected but are not attacked as part of our 
solution to the frame problem. 

Definition 4.4 Given an assumption-based framework (T,AB), a set of assumptions A C 
AB leniently rejects an assumption 8 £ AB iff 

(a) A rejects 5, and 

(b) A does not attack S. 

def 

We denote Lr(A) = {5 € AB \ 5 is leniently rejected by A}. 

To show that our solution provides an intuitive account for problems of reasoning about 
action, several scenarios should be considered. These include the projection problem, the 
most basic form of the frame problem, whose typical example is the infamous YSP. Another 
scenario concerns with the explanation problem which are usually discussed with the Stolen 
Car Problem (Kautz, 1986) and the Stanford Murder Mystery (Baker, 1989). We will first 
provide an informal discussion of our approach through these examples. 

In the present solution, the frame assumptions are the essence of the principle of iner- 
tia, and their role in the argumentation approach is illustrated below by the Yale Shooting 
Problem. In this formulation we intentionally ignore the qualification problem (it is ad- 
dressed in the next section) to highlight how the frame problem is solved. We now recon- 
sider the well-worn example YSP to motivate our approach to the frame problem. 

Example 4 (continued) Given the theory r Y sp, the argumentation-theoretic approach will 
yield the following preferred set of assumptions (Bondarenko et al., 1997): 

{[tjF^ \teT and I € {loaded, alive, -^loaded, -^alive}} \ {[0]FA^i oa d ec i, [2]FA a i ive }, 
which corresponds to the intended model of this scenario in which the gun remains loaded 
at time point 2 and the victim is not alive at time point 3. 

This extension is also the stable extension and well-founded semantics (Bondarenko 
et al., 1997) of the given theory under the argumentation-theoretic approach. Note that in 

10. In fact, any set of assumptions containing the assumption [l]FAi oa d e d would attack [2]FA a u ve . 
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case one would like to be uncertain about whether the gun is still loaded after the shooting 
action, one just simply needs to add an axiom: [r, v]shoot — > _i [t]F Ai oa d e d to dictate that 
the persistence of the fluent loaded after the action shooting is not guaranteed. In that 
case, we can still derive that [r]loaded for r = 1,2, but we can no longer give a definite 
assertion about [r]loaded for r > 3. 

As the above formalisation of YSP resembles that using default logic, it may be sur- 
prising that the problem of unintended models pointed out by Hanks and McDermott 
(1987) for circumscription, default logic, autoepistemic logic does not happen here. The 
principal reason is the interaction of the inference rules and the notion of attack in the 
argumentation-theoretic framework, which invalidates undesired assumptions. Notice that 
even if —>[2]loaded can be (magically) derived, it cannot lead to ^[l]FAi oa d e d- Therefore, the 
set of assumptions corresponding to this case does not satisfy the conditions of preferred 
set of assumptions, thus ruling out this unintended model. This shows one of the important 
features of assumption-based frameworks on its capability of making explicit the assump- 
tions used by the reasoner during the course of inference. Recall that defaults' justifications 
are accepted as long as they are consistent with some extension for credulous semantics 
or all extensions for skeptical semantics (thus the name consistency-based approach.) In 
light of the inertia principle, it's considered to be abnormal if a fluent does not persist 
from a state to the next state. To minimise the abnormality, (normal) default rules are 
introduced to express the fact that if it's consistent to believe that there is no abnormality 
with respect to a fluent / and an action a in a situation s then assert that. But then we 
would fail to distinguish between the abnormalities brought about by reasonable causes and 
those unintuitively generated to make them consistent with some possible extension. The 
latter is of course corresponding to the anomalous models. By using explicit assumptions, 
not only consistency is maintained (by preventing the accepted assumptions from attacking 
themselves) but each rejection of assumptions must also be justified by the known facts 
from the given theory. 

Discussion: 

1. Turner (1997) showed that an alternative representation of the YSP in default logic 
can help solve the issue of anomalous models introduced by Hanks and McDermott 's 
(1987) representation. Turner formulates the Yale Shooting scenario as follows: 



^Holds(Alive, So) 



(11) 



False 



True 



(12) 



Holds(Loaded, Result(Load, s)) 



Holds(Loaded, s) 



(13) 



^Holds(Alive, Result(Shoot, s)) 



: Holds{f,S ) 



(14) 



Holds(f,S ) 
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: -,Holds(f,S ) 
^Holds(f,S ) 



(15) 



Holds(f,s): Holds(f, Result(a, s)) 



(16) 



Holds(f, Result(a, s)) 



— i. 



>Holds(f, s) : ->Holds(f, Result(a, s)) 



(17) 



-*Holds(f, Result(a, s)) 



Notice that Turner also uses the inference rules to block the "backward" reasoning 
that generates the anomalous models of the Yale Shooting scenario. However, this also 
means that all kinds of useful backward reasoning will also be blocked. In other words, 
Turner's formulation fails to deal with "surprising" observations about states at later 
time points. As a consequence, Turner's formulation only works when the domain is 
restricted to qualification-free. As soon as the action descriptions, e.g. the one for 
the shoot action in YSP, need to rely on some default justifications, e.g. qualification 
assumptions, Turner's formulation would also encounter the problem of undesirable 
extensions. Our approach offers solutions to both of the above issues. 

2. After Hanks and McDermott's (1987) seminal paper in which early approaches to 
the frame problems were exposed, besides new attempts to solve the frame problem, 
Sandewall (1994) should be accredited as the first who tried to approach the prob- 
lems of reasoning about action in a systematic way. As part of this effort, he also 
examines the reason behind the failure of early approaches to the frame problem. As 
discussed by Sandewall, early approaches to reasoning about action while attempting 
to formulate the inertia principle have made the common mistake of making changes 
the abnormality regarding this principle but failing to distinguish between normal 
changes triggered by actions and anomalous changes. This important insight turns 
out to be a consequence of a much more general law for reasoning about dynamic 
domains discovered by researchers in the community in pursuit of solutions to various 
problems of reasoning about actions: "action dynamics are causality-based. " It is this 
principle that underpins most solutions to the problems of reasoning about action. 
The anomalous models that arise in early approaches to the frame problem discov- 
ered by Hanks and McDermott (1987) or to the qualification problem as discussed 
by Thielscher (2001) are those in which the causes of abnormalities are not present. 
On the other hand, regarding the ramification problem, given a domain constraint 
involving a number of fluents, it's important to know which of these fluents are the 
causes influencing the other fluents, i.e. the causality direction between the involved 
fluents. 

In light of the above analysis, Turner's (1997) approach appears to be rather ad hoc. 
Note that Turner's solution to the problem of anomalous models is to block "back- 
ward reasoning" by the use of inference rules without any motivation on why backward 
reasoning is a bad thing. While his approach appears to share with solutions based 
on chronological ignorance (which will be discussed in more details in Section 7) the 
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notion of directedness: By minimizing chronologically or blocking backward reason- 
ing, one tends to minimize causes rather than effects. However, a more systematic 
approach to various problems of reasoning about action is still very much desired. 

Nevertheless, while the preferability semantics copes successfully with the YSP, it can 
not properly account for the explanation problem, e.g. the Stanford Murder Mystery (Baker, 
1989), the Stolen Car Problem (Kautz, 1986). The subtlety lies in the derivation of the 
contrary of the frame assumptions. The contrary of a frame assumption is derived only 
when both the occurrence of the event that brings about the change (absent in the Stolen 
Car Problem) and the preconditions required to be satisfied for the change to actually take 
place (absent in the Stanford Murder Mystery) are explicitly derivable. This is where the 
notion of (leniently) rejected assumptions is called into service. 

Definition 4.5 Given an assumption-based framework FA =(T, AB), a set of assumptions 
A C AB is presumable wrt FA iff 

(a) A = {5 € AB | T U A (5} (in the terms given in Bondarenko et al., 1997, A is 
closed) , 

(b) A does not attack itself, and 

(c) for each assumption S A, S is rejected by A. 

Definition 4.6 Given an assumption-based framework FA =(T, AB), a set of assumptions 
A C AB is plausible wrt FA iff 

(a) A is presumable, and 

(b) there exists no A' C AB such that A' is presumable and Lr(A') C Lr(A). 

We now proceed to formalising action theories in our framework. 

Definition 4.7 Let a = (T, T, A) be a signature. Assume r, v € TS, a G A, $ C A, and 
/ G J 7 *. A domain description D (over a) is a tuple (£d, H, AB, F), where: 

1. Cd is the domain description language and AB is an assumption base over a; 

2. K = K c U Tl F U TZ A U Kq, where 

(a) TZc is the set of inference rules of (classical) propositional logic; 

[t]1, [t]FAi 

(b) TZf is the set of frame-based inference rules of the form: ■ + ^ , i.e. those 

that represent the frame axioms in terms of inference rules; 

(c) TZa is the set of action descriptions which are inference rules of the form: — , J—^ — 3 — '/'^ ^ l . 

[v]l A ->[t]FA-,i 

i.e. those that represent the conditions for the action a to bring about I; and 

(d) TZq is the set of qualification-based inference rules of the form: — ■ ^ , i.e. 

those that represent the qualifications regarding the fluent literal I. 

3. The theory T C A. 

Given a set of assumptions A, we denote Afa = A n ABfa and A^q = A n ABaq- 

Observation 2 Let D = (Co, Tl, AB, T) be a domain description, for each set of assump- 
tions A C AB, either A is closed or A attacks itself. 
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5. Reasoning about Action: The Frame and the Qualification Problems 

In general, we adopt the following guidelines in seeking a uniform solution to the problems 
of reasoning about action: 

• The derived pieces of information do not conflict with the given facts; 

• Occurrences of events are minimised; and 

• The inertia of fluents is maximised though the minimality of the event occurrences 
will be of higher priority. 

Aside from the trivial case of occurrences of actions causing the frame assumptions to 
be rejected, two aspects of actions can be distinguished: 

1. An action happens but the change it is supposed to cause does not take place. We 
call this expectation failure and this is more or less the qualification problem; and 

2. No actions that are known to have happened and caused a change but the change 
did take place. We call this surprise and this is usually known as the explanation 
problem. 

The following assumption represents our underlying intuition behind reasoning about 
action formalisms. 

Assumption 1 Intuitive models contain minimal (with respect to set inclusion) sets of 
surprises. 

Now we introduce some model-theoretic counterpart notions of the assumption-based 
notions presented above. 

Definition 5.1 Let a = (T,T,A) be a signature and D = (Cjj,TZ, AB,F) a domain de- 
scription over a. An interpretation / = (h, (j), r), s q ,£f) is a model of D iff 

1. / is a model of V; 

2. for each r € 1Z, if / |= prem(r) then / |= cons(r). 

The following definition captures one of several aspects of the (model-theoretic) solution 
of the frame problem. This aspect is known as the action-oriented frame problem in Lin 
and Shoham's (1995) terms. The proposed minimisation policy formalises the intuition that 
change does not happen by itself but is caused by some kind of event. Thus, for each fluent, 
if its value is changed between two timepoints r and v, (at least) an occurrence of some 
event must end at v that brings about that change. 

Definition 5.2 Let D = (jCd,T^,AB,T) be a domain description and / a model of D. I is 
a coherent model of D iff 

1. for each basic action a £ Aq and r, v G T£, if / |= [r, v]a then r |= [r, v\a ; and 
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2. for each I G and t G T, if I \= [t]l A ^[t + ]l then either 



(a) there are a G Aq and s G T such that r 



$, [Ti,r 2 ]a, [ri,r 2 ]^Q^ 
-[r 2 ]Z A -.[n]FA, 



G 7£ and 



/ |= prem(r)[ri/s, T2/t + ] 
(b) /HMl^l 



ii 



or 



Thus, in a coherent model: (i) all satisfiable basic actions must follow from the given 
theory, and (ii) all changes are attributable to events of one kind or another. 

Given an interpretation 7, we want to extract the sets of assumptions satisfiable in 7. 

Definition 5.3 Let a = (T,F,A) be a signature and 7 an interpretation over a. The set 
of frame assumptions satisfiable in 7, denoted Ap A , is defined as follows: 



Conversely, given a theory T and a set of assumptions A, a reasoner can also construct 
his models about the domain of interest. 



Definition 5.4 Let D = (£d, AB, T) be a domain description and A C AB. A model 
7 = (h, (ft, r), £ q ,£f) of D is A-relativised iff 

1. for each S G AB, I \= S iff S G A; and 

2. Occ 1 = OA D U DAS (A), where: 

(a) OA D = {(<Kri),a,<KT 2 )) G T x ^ x T | < ^ [r^a}, and 

(b) TJAS'(A) = {(t, da^ h t + ) G T x T>A x T | [«]FA< £ > and there do not exist any 



A-relativised models are one of the central notions of our framework. Essentially, as- 
sumptions underpin our machinery to conjecture information based on common sense knowl- 
edge. As such, we will try to accept as many assumption as possible unless there is a good 
reason not to. Therefore, given a set of assumptions, we will attribute every missing frame 
assumption to a possible change in the domain the agent is reasoning about which is caused 
by either a known action/event or some unknown action, called dummy actions in this 
paper. 

The following observation is immediate from condition (1.) in the above definition. 

Observation 3 Let a domain description D = (£d, 1Z, AB, F) and a set of assumptions 
A C AB be given. If the model I of D is A-relativised then Aq F = I(A,t) for every t G T. 

11. The notation ip[vi/ti, ... ,v n /t n ] is standard in logic and meant to be the instantiation of the formula tp 
with the variables vi, . . . ,v„ being replaced by the terms ti, . . . , t n , respectively. 




action 



a G Aq and s G T such that r = 
prem(r)[Ti/s, T2/t + ]}. 



$, [Ti,T 2 ]a, [t 1 ,t 2 ]AQ^ 
^[t 2 }1 fK^FAi 



G K and 7 |= 
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5.1 The Frame Problem 

First we will address the frame problem in a simple setting viz. without qualification 
assumptions, but we will lift the restrictions later. 

Definition 5.5 Let D = (Cd,7Z, AB,T) be a domain description. D is a simple domain 
description, or S-domain, iff TZq = and AQ does not occur anywhere in 1Z or V. 

Definition 5.6 Let D = (£r),1Z,AB,r) a domain description. An interpretation / = 
(h,(f),r),£q,£f) is a simple model, or S-model, of D iff 

1. / is a model of D; and 

2. e q {t,AQi,u) = true for every (t,AQ h u) £Tx AQ^» x T. 

This effectively isolates the frame problem from the qualification problem. Note also 
that if / is an S-model then A^q = ABaq- A coherent S-model is an S-model which is 
coherent. 

Example 4 {continued.) The following is part of one of the coherent models of D YSP : 

{[0, l]load, ^[0]loaded, [l]loaded, [0]alive, [l]alive, 

[I, 2}wait, [1, 2]da^i oaded ,^[2]loaded, [2]alive, 

[2, 3]shoot, ~^[3}loaded, [3]alive}, 
which corresponds to one of the anomalous models of this scenario (the one pointed out by 
Hanks and McDermott). 

But it is not desirable to admit the occurrence of an event when there is no evidence 
for it. Thus we need to minimise the set of action occurrences in a given action theory. 

Definition 5.7 Let D be an S-domain. A coherent S-model / of D is a prioritised minimal 
model (or simply PMM) of D iff there does not exist any coherent S-model I' of D such 
that Occ 1 ' C Occ 1 . 

Note that the above model-theoretic minimisation policy is not based on the frame 
assumptions. This solution to the frame problem is thus amenable to well-known techniques 
such as circumscription 12 , but we believe an argumentation-theoretic approach is not only 
more direct but also has wider applicability. In order to provide the connection between 
the above (model-theoretic) minimisation policy and the (argumentation-theoretic) notion 
of plausible sets of assumptions we need to maximise the set of assumptions satisfiable in a 
PMM. 

Definition 5.8 Let D be an S-domain. A PMM / of D is a canonical prioritised minimal 
model (or simply CPMM) of D iff there does not exist any PMM I' of D such that 
FA 1 c FA 1 ' . 

We now want to see how the account of plausible sets of assumptions connects to this 
account of minimality. 

12. in combination with the introduction of occurrences of dummy actions. 
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Lemma 1 Let D = (£d,1Z, AB,T) be an S-domain. If I is a CPMM of D then for each 
assumption 5 G AB: 5 ^ ^qf & *s rejected by Aq F . 

Proof. (=>) Suppose by way of contradiction that 5 is not rejected by Aq F , then Aq F U{5} is 
^-consistent, i.e. TU Aq F U {5} \/n false. Since D is an S-domain, ABaq C Aq F . Assume 
that 5 = [t\FAi for some r G TS and I G J 7 *, we can construct an interpretation I' in such a 
way that i 7 interprets everything except FA the same as / and FA 1 ' = F 'A 1 U {(<f>( T ) , FA;)}. 

Since / is a PMM of D, from the above construction, /' is also a PMM of D. But 
FA 1 C FA 1 ' . Contradiction. 

(<^=) Obvious. □ 

Lemma 2 Let D = (Crj,TZ,AB,T) be an S-domain and I a CPMM of D. If there are 
t£T and I £f* such that [t]FA t G Lr(A I QF ) then I \= [t,t + }da^i. 

Proof. Let 5 denote the assumption [i]-F\Aj. First we observe that 5 G L>(Aq F ) implies 
5 G" Aq^ since 5 is rejected by Aq^ and Aq F does not attack itself. This in turn implies 
that I \= {[t]/, as the denotation of FA in / is required to be maximal since / is a 

CPMM of D. From the condition that / is coherent, either (i) there are a £ Ao and s G T 
such that 

= $,[ri,T 2 ]a, [ti,t 2 ]AQ^ 

and / |= prem(r)[Ti/ s,T2/t + ], or (ii) / |= [t,t + ]da^i. Condition (i) guarantees that 5 is 
attacked by Aq F and thus 5 can not be a member of Lt{Aq F ). Therefore, (ii) must be the 
case. □ 

The converse of Lemma 2 does not hold. There are cases in which / |= [t,t + ]da^i and 
the assumption [t].P\Aj is attacked by Aq F as a basic action occurs that changes the fluent 
literal I. 

Theorem 1 Let D = (C D ,TZ,AB,T) be an S-domain. If I is a CPMM of D then A T QF is 
plausible. 

We now prove that not only can we derive a plausible set of assumptions from a given 
CPMM but we can also construct CPMMs from a plausible set of assumptions of a given 
S-domain. 

The set of A-relativised models of an S-domain D is denoted as Mod^(D). 

Observation 4 Let D be an S-domain and A a set of assumptions of D. For each I G 
Mod s A (D), A = A I QF . 

Proof. From the construction of A-relativised models: 

For each I G Mod^(D), 5 = [t]FA 1 G A iff I \= [t]FAi iff 5 G A FA . (More precisely, 
we have the assumption [(f>(r)\FAi is in A^, where <j> is the valuation defined in I. But 
relative to /, it is identical to 5.) 

Therefore, A = Aq F . □ 
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Theorem 2 Let D = (£d, 1Z, AB, T) be an S-domain and A C AB. A is plausible wrt D 
iffMod s A (D) + and for each I G Mod%{D), I is a CPMM ofD. 

Theorem 3 Let D = (£d,1Z, AB,T) be an S-domain. Furthermore, suppose that CPMM (D) 
is the set of CPMMs of D and Plaus(D) is the set of plausible sets of assumptions of D, 
then CPMM(D) = [) AePlaus(D) Mod s A (D). 

5.1.1 Discussion: 

So, how does our account of the frame problem relate to the existing approaches to the frame 
problem? While there has been a long line of development behind monotonic approaches 
to the frame problem starting with Haas's (1987) and Schubert's (1990) early attempts and 
resulting in Reiter's (1991) monotonic solution to the frame problem together with other 
solutions proposed by others such as Castilho et al. (1999) and Zhang and Foo (2002) or 
Thielscher's (1999) Fluent Calculus-based monotonic solution to the frame problem, with 
the notable exception of Thielscher's (2001) attempt to address the qualification problem, 
few have tried to tackle the qualification within the framework they use to address the frame 
problem. 

On the other hand, in the action languages (Gelfond k, Lifschitz, 1998) and related 
approaches such as those proposed by McCain and Turner (1995, 1997), Giunchiglia, Kartha, 
and Lifschitz (1997), and Giunchiglia and Lifschitz (1998), state transition systems are 
employed as the underlying computation machinery which essentially provides the reasoner 
with all possible complete states of the world. Furthermore, as domain decsriptions can 
be uniquely translated to state transition systems, the reasoner could safely derive the 
successor state(s) based on the current together with the transition function. 

5.2 Solving the Qualification Problem (in the Presence of the Frame Problem) 

The results reported in the previous section are established in a simple setting. If we add 
the following observation to the theory in example 4: [3]alive, i.e. after the shoot action, 
the victim is still alive, then like most existing formalisms, the above account of plausibility 
would come up with a contradiction. In fact, it would be more reasonable that such a 
failure is explained as an occurrence of some qualification. In this section, we remove certain 
restrictions on the qualifications of actions in order to achieve a more general framework. 

There are some subtleties in the way action theories are represented in our proposed 
assumption-based framework. Note first that there is a potential difficulty if frame assump- 
tions and qualification assumptions are treated equally, which can be illustrated by a version 
of the YSP. Consider the following action description: 

[rjalive, [T}FA a i ive [r]loaded, [r, v ]shoot, [r, v]AQ-, a i ive ^ 
[r + ]alive ->[v]aliv e A ->[T]FA a n ve ~ 

{[0}loaded, [0]alive, [0, l]shoot} C T. 

From this, we have (at least) two stable sets of assumptions: one contains the frame 
assumption [Oj-FVLj^e which rejects the qualification assumption [0, l\AQ^ a n ve and another 
contains [0, l]AQ^ a u ve which attacks [0]i^^4 a /i„ e . Only the latter is intuitive in this case but 
we do not have any explicit criterion to prefer one over another. The following assumption 
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asserts that in our solution to the frame problem in the presence of the qualification problem, 
an action is presumed to bring about its effects unless there is an explicit justification for 
its disqualification. 

Assumption 2 When there is a direct conflict between a frame assumption and a qualifi- 
cation assumption (over a fluent literal), the qualification assumption takes precedence. 

Given the presence of several kinds of assumptions, i.e. frame and qualification, we 
will adopt the following convention: we will write Lrp(A) instead of (Lr(A))p for P € 
{FA, AQ}. Since we no longer exclude qualification assumptions from our assumption- 
based domain descriptions, we will simply refer to assumption-based domain descriptions 
as Q- domains. 

Definition 5.9 Let D = (£p,,7Z, AB,T) be a Q-domain. A presumable set of assumptions 
A C AB is semi-Q-plausible wrt D iff LrpA(A) is minimal (with respect to set inclusion). 

Definition 5.10 Let D = (Cpj,TZ,AB,T) be a Q-domain. A set of assumptions A C AB 
is Q-plausible wrt D iff 

1. A is semi-Q-plausible wrt D, 

2. Aaq is maximal, i.e. there does not exist any A' C AB such that A' is semi-Q- 
plausible (wrt D) and A^q C A' A q, and 

3. Apa is maximal relative to the above two conditions, i.e. there does not exist any 
A' C AB such that A' satisfies the above two conditions and Apa C A' FA . 

We will now refer to models of a Q-domain as Q-models. A coherent Q-model is a Q- 
model which is coherent. We minimise the set of action occurrences in coherent Q-models 
of a given action theory. 

Definition 5.11 Let D be a Q-domain. A coherent Q-model I of I? is a prioritised minimal 
Q-model (or simply PMQM) of D iff there does not exist any coherent Q-model I' of D 
such that Occ 1 C Occ 1 . 

Definition 5.12 Let D be an S-domain. A PMQM I of D is a canonical prioritised minimal 
Q-model (or simply CPMQM) of D iff 

1. there does not exist any PMQM I' of D such that AQ 1 C AQ 1 ' , and 

2. there does not exist any PMM I' of D such that FA 1 C FA 1 ' . 

Now we can proceed to obtaining the main results for CPMQMs regarding Q-plausible 
sets of assumptions which are similar to those for CPMMs regarding plausible sets of as- 
sumptions. The following lemma, which is a straightforward extension of Lemma 1 and 
Lemma 2 proved in the previous section, is introduced to assist in the proof of Theorem 4 . 

Lemma 3 Let D = (£d,1Z, AB,F) be an Q-domain and I a CPMM of D, 
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1. For each assumption 5 € AB: 5 ^ ^qf $ ^ ^ s r ^i^cted by A^ F . 

2. If 5 = [t]FA 1 € Lr(^ QF ) then I \= [r,T + ]da^. 

Theorem 4 Let D be a Q-domain. If I is a CPMQM of D then Aq F is Q-plausible wrt 
D. 

Similar to the previous section, we now prove that not only can we derive a plausible set 
of assumptions from a given CPMQM but we can also construct CPMQMs from a plausible 
set of assumptions of a given domain description. The set of A-relativised models of a 
Q-domain D is denoted as Mod^(D). 

The following observation is obvious: 

Observation 5 Let D be a Q-domain and A a set of assumptions of D. For each I € 
Modl(D),A = A I QF . 

Theorem 5 Let D = (£rj,7Z, AB,T) be a Q-domain and A C AB. A is Q-plausible wrt D 
ijfModl(D) + and for each I € Mod^D), I is a CPMQM of D. 

Theorem 6 Let D be a Q-domain. Furthermore, suppose that CPMQM(D) is the set of 
CPMQMs of D and Plaus^(D) is the set of Q-plausible sets of assumptions of D, then 
CPMQM(D) = {J AePlausQ{D) Modi(D). 

Q-plausible sets of assumptions allow one to overcome scenarios in which expectation 
failures (or, qualification surprises) arise, e.g. shooting a turkey with a loaded gun and 
observing that the turkey is still alive. When such surprises arise, the reasoner knows 
who's to blame: qualification assumptions. She can then accordingly remove the "guilty" 
assumptions. Just as the anomalous models forming obstacle to early approaches to the 
frame problem, similar anomalous models can also arise in solutions to the qualification 
problem. This important issue related to the qualification problem has been thoroughly 
discussed by Thielscher (2001) and a solution was presented within the framework of the 
Fluent Calculus. To give the reader a flavour of this problem within our framework, we 
invite the reader to consider the following classical example: 

Example 5 Consider the problem of starting a car whose tail pipe could possibly be 
blocked by a potato, formalised in our formalism as follows. 

1. The set of inference rules TZ is: 13 
[r]BlockedTP 

-■[r, V^Qcetstarted 

[rjHasPotato, [r, v]InsertPotato, [r, v]AQBiockedTP 
[vjBlockedTP A ^[T]FA^ BlockedTP ' 
[T]HasKey, [r, v]TurnOnIgnition, [r, v]AQ Get started 
[v]Get Started A ->[t]F A^ G etStarted 

13. Of course we also have the frame-based inference rules for HasKey, BlockedTP, etc. but we omit them 
from this representation for sake of readability. 
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2. The theory T is: {[0]HasPotato, [0}HasKey, -^[0]BlockedTP, -n[0]GetStarted, 
[0, l]InsertPotato, [1, 2]TurnOnl gnition} . 

Of course, we have designed this example to try to avoid any possible troubles with 
the frame problem. We have to consider two conflicting qualification assumptions in this 
case which are [0, l]AQBiockedTP and [1, 2]AQQ et st a rted- Given the above action theory, any 
Q-plausible set of assumptions would contain exactly one of them. Thus, there will be at 
least two extensions, one in which the car can not get started since the tailpipe is blocked 
and it's no longer consistent to assume [1, 2]AQQ et started- The other extension disqualifies 
the action of inserting the potato into the tailpipe and thus the action of starting the car 
becomes successful. Only the former is intuitive in this case and the account of Q-plausible 
sets of assumptions fails to deliver this desired solution. 

However, in exactly the same way the problem of anomalous models arising in the solu- 
tion to the frame problem is tackled, the above problem is easily addressed within our frame- 
work. The key insight is of course also underlined by the notion of causality: [l]BlockTP 
was caused (by the action [0, l]InsertPotato) which in turn allows ->[1, 2]AQGetstarted to be 
derived. On the other hand, there was no cause that allows -i[0, l]AQBiockTP to be derived. 
How is the above insight realised in our framework? The answer turns out to be rather sim- 
ple: Just as the distinction between leniently rejected frame assumptions and non-leniently 
rejected frame assumptions allows us to distinguish between normal changes (i.e. action- 
triggered) and anomalous changes, a distinction between leniently rejected qualification as- 
sumptions and non-leniently rejected qualification assumptions will allow us to distinguish 
between normal disqualifications (i.e. those underlined by a cause) and anomalous disqual- 
ifications. Thus, facing a collection of Q-plausible sets of assumptions, a reasoner simply 
selects the set of assumptions that contains the smallest (with respect to set inclusion) set 
of leniently rejected qualification assumptions. 

The ability to introduce different argumentation-theoretic semantics for assumption- 
based frameworks is arguably the biggest advantage of our approach. The following example 
illustrates this critical point: 

Example 6 We modify an example presented by Lin and Shoham (1995) which is in turn 
a modification of Kautz's (1986) Stolen Car Problem. A spy possessed a microfilm of a top 
secret evidence which an organisation, A, tried to steal. For some reason, another organi- 
sation, B, wanted to murder this spy. The microfilm was in the safe at the spy's home at 
time 0. The spy was not at home at time 0. A tried to steal the evidence between the 
time points and 1. The spy might return home at any time between and 1. B tried to 
murder the spy at any time between and 1. return cancels the effects of steal, murder 
cancels the effects of return and steal cancels the effects of murder. Any of the three 
actions steal, return, and murder takes only one time step. The domain is formalised as 
follows: T = {^[0]Ev Stolen, [0]Alive, ^[0]AtHome}; and 1Z contains 

[T,v]steal, [t, v] AQ EvStolen [r, v]return, [r, v] AQ AtHome [r, v]murder, [r, v]AQ^ AHve 
[v] Ev Stolen A -. [r] FA^ EvStoUn ' [v] At Home A -> [r] FA^ AtHome ' -. [v] Alive A -> [t] FA AHve 

[r]AtHome A r < v —\r\Alive At < v [r]EvStolen A r < v 
-^[r,v] AQ E vStoien ' ^[r,v]AQ AtHome ' ->[T,v]AQ^Alive 
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Given the above formalisation of the problem, traditional accounts of non-monotonic 
reasoning (i.e. Default Logic, circumscription, Autoepistemic Logic, etc.) can not provide 
one with a solution since these formalisms can not produce any extension under their stan- 
dard semantics. However, the argumentation-theoretic approach does gives several seman- 
tics for this problem including preferability semantics. Note, however, that all admissible 
sets of assumptions and preferred sets of assumptions for this domain contain none of the 
assumptions: [0, l]AQ Ev Stolen, [0, l]AQ A tHome, and [0,l]AQ^ AHve . This essentially means 
that, under the admissibility and the preferability semantics, the reasoner could only infer 
that none of the above actions would succeed On the other hand, our proposed plausible 
semantics gives an alternative solution for this problem in which each consistent set of as- 
sumptions can contain at most one of the following three assumptions: [0, 1\AQe v Stolen-, 
[0, 1]AQ AtHome, and [0, l]AQ^ A Uve- Moreover, each plausible set of assumptions must con- 
tain exactly one of them. Among the other two assumptions which do not belong to a 
plausible set of assumptions, one is attacked and the other is leniently rejected. 

We believe that the above examples have underlined the major advantages of our ap- 
proach in which a reasoner is aware of the (defeasible) assumptions used in her reasoning as 
well as being able to explicitly reason about these assumptions. The flexibility of allowing 
a reasoner to introduce different argumentation-theoretic semantics for assumption-based 
framework by simply varying the notion of acceptability of sets of assumptions is certainly 
another advantage in favour of our approach. 

6. More Complex Dynamic Domains and Indirect Effects 

So far we haven't taken into consideration the issues of concurrent actions and indirect 
effects. To ensure that the formalisation introduced is expressive enough to deal with 
complex domains, we will show how these issues are coped with by our approach. Firstly, 
we motivate our formalisation with an informal discussion. 

6.1 Concurrent and Non-Deterministic Events 

Given our temporal representation, formulating concurrent events is not a difficult issue in 
our framework. However, there are some subtleties which need to be carefully considered. 
Firstly, the use of assumptions. As presented earlier in this paper, qualification assumptions 
are fluent oriented, i.e. we qualify over the effects of action rather than over the action itself. 
Whilst this manifests the capability of formulating actions with multiple effects, and thus 
each effect should be qualified independently, it may fail to formalise concurrent events 
with the same effects. For example, both actions hit the vase with a hammer and shoot 
it with a loaded gun bring about the effect that the vase is broken. In other words, it 
is essential that qualification assumptions be dependent on the actions that bring about 
the effect under consideration. Thus, given n actions and m fluents whose values can 
be changed by those actions, we have to potentially introduce 2 x m x n qualifications 
assumptions. 14 Therefore, instead of subscripting the assumption symbols AQ with the 
fluent literals from J 7 *, we extend the set of subscripts of AQ, denoted as AT, to contain 

14. In fact, as we will see later, there are potentially 2 x m x (n + 1) qualification assumptions in this case 
since there is one special event corresponding to all (natural) events that bring about the indirect effects. 
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both the action and the corresponding fluent literals. For example, given the above two 
actions hit and shoot and an additional action repair whose effect is change a broken vase 
to being non-broken, viz. -^broken, we will need to introduce the following qualification 
assumptions: AQmt- Broken, AQ 'shoot- Broken and AQ Repair -^ B roken- Therefore, syntactically 
we also extend the set ABaq = {[r^jiQ^, | r, v G TE and ip <G AT} and semantically 
the function e q : T x AQ_4jf x T — > {true, false}. In the definition of an interpretation 
/ = (h,(f),r],£ q ,ef), we also have I([T,v}AQ lfi ,t) = e ? (0(r), AQ^, 4>{v)), where t,v E TE 
and ip G AT. 

Though this does increase the complexity of the framework, it is the price we have to 
pay for the expressiveness of the resulting system. To the best of our knowledge, none of 
the existing formalisms possesses such an expressiveness. 

How about non-deterministic actions? The solution turns out to be quite simple: we can 
treat action non-determinism as a special kind of action qualification. For example, to for- 
mulate the Russian shooting scenario (Sandewall, 1994) in which a gun non-deterministically 
gets loaded or not after spinning its revolver, the following action descriptions can be as- 
serted: 

[T,v]spin, [T,v}AQ Sp in- Loaded [T,v]spin,[T,v]AQ Sp in-^Loaded 

aari = — j— r . ; — ; . , - -. and adr2 = r^n t~, rrm 

[v\ loaded A -i [t\ FA^ oaded " [v\ loaded A -. [r\ FAi oaded 

together with the following two qualification rules: 

\v\loaded . -<[v]loaded 
qn = ~1 fTT) and qr2 = ~1 TJr> • 

->[T , V\AQ S pin- ^Loaded ^[T , V\AQ Spin- Loaded 

The above guarantee that either -<[v]loaded or [v]loaded will follow from [r,v]spin (re- 
mark that the set of qualification assumptions Aaq is maximised), but not both. As a 
consequence, two possible extensions will arise given the above non-deterministic action. 

Dealing with non-determinism could be more complicated when the information used to 
encode the action description is disjunctive. As we only restrict the conclusion of an action 
description rule to contain only fluent literals, such disjunctive effect is not straightforwardly 
dealt with in our framework. However, note that the restriction is similar to that imposed 
on action language A (Gelfond & Lifschitz, 1998). An extension to action descriptions 
which is similar to the way the action language A is extended into the action language 
C can be done to allow a complex expression in the conclusion of action description rule. 
However, for the sake of presentation, we choose to use a simpler language to introduce our 
framework to the reader. 

6.2 Formalisation 

From the analysis in the introductory section regarding indirect effects, we observe that 
the ordering in which domain constraints are applied plays an essential role in a technically 
sound framework. Moreover, it's no longer guaranteed that domain constraints would be 
strictly satisfied at every time point. 16 To help the reader better understand this technical 
subtlety, it's useful to think that changes are attributable to events. However, events 

15. The reader is referred to section 3 for the general formalisation. 

16. Of course, it's not necessary that the state of the world at every time point is observable to a reasoner. 
However, it is important that she be aware of such states and able to reason about them. 



497 



Vo & Foo 



are further divided into two categories: external and internal. Basically, external events 
correspond to the direct effects of actions performed by some agents (including the reasoner.) 
On the other hand, internal events correspond to the indirect effects when certain conditions 
about the world are met and can be attributed to Nature. 17 

Like external events, internal events also happen in a certain order. Although it is not 
straightforward to observe this order 18 , it is important that a reasoner be able to reason 
about them. Hence we propose to add one more dimension into the set of assumptions 
of a given domain description. Since these assumptions play essentially the same role as 
that of qualification assumptions, 19 we can subsume them under the set of qualification 
assumptions AQxf- As they are not associated with any specific action, we can ignore the 
initial of the action name from the subscripts of AQ. For example we will write ^.^frrofcen 
in case we want to qualify over the fluent broken as an indirect effect, i.e. independently of 
any action. Moreover, to avoid the axiomatiser from the confusion of determining the time 
span taken by indirect effects, we will assume that it is atomic. It means all indirect effects 
always take place between one time point and the next one. This does not mean that all 
indirect effects have the same real-time duration, it simply means that relative to the given 
time structure T they take place between two consecutive time points. This allows us to 
avoid the granularity problem as it is irrelevant from the viewpoint of the problems we are 
trying to solve. 

6.2.1 A Representation Issue and Some Notations: 

One important remark is in place here. Until now, we have used integers and the corre- 
sponding expressions to denote time points. There are two reasons for this pratice: (i) It 
significantly simplifies the presentation, and (ii) Without the complication of the ramifica- 
tion problem, all time points which are reasoned about are also observable to the reasoner. 
However, as will be discussed thoroughly in the next section, in the presence of ramifications 
a time point at which some change takes place maight not be observable to the reasoner as 
such a change could be one of the indirect effects after the execution of some action. Such 
representation issues make the integer-based time structure employed so far in this paper 
inappropriate. We do need a richer representation of time structure. Following Sandewall's 
(1994) basic formulation, the only basic constant to be included in the representation of 
the time structure T is denoted by the symbol O and is referred to as the origin of T. 
The standard algebraic operations + and — are still employed to obtain time expressions 
and bear their usual meanings. The relation symbol < will also be used to compare time 
expressions. However, we can no longer allow expressions such as O + 1 for integers are no 
longer elements of the time structure. 
Given a time expression r: 



17. We avoid the use of the terms exogenous/endogenous events to label these two categories because 
throughout the literature of reasoning about action, exogenous events are used to refer to actions that 
carried out by agents that are different from the reasoner or outside events whose occurrences are beyond 
the reasoner's control. 

18. Unless indirect effects are somehow delayed and become observable to the reasoner, they usually take 
place immediately after direct effects. 

19. The only difference is that these assumptions are qualified over the indirect effects which can be considered 
to be the effects of the actions of Nature. 
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• We will continue to denote the next time point of r by r + . 

• We define r 1+ to be r+ and, let n > 1, r n+ to be (t^-^ + ) + . 

Furthermore, as we will assume throughout that an indirect effect takes place between 
two consecutive time points, we also simplify the presentation by using the following syn- 
tactical sugar: instead of writing [t,t + ]AQi (for some r G T£ and / G J 7 *), we will write 
[r]j4Qi. This also provides a simple way to distinguish between qualification assumptions 
for ramificational effects and those caused directly by an action or event. 

How are domain descriptions affected from this augmentation? The only change is for 
the set TZa of action descriptions which consists of rules either of the form 

$,[t, v]a,[T, v}AQ a -i 
[v]l A n[ T ]FA^ 

or of the form 

*, [t\AQi 
[t+]1 An[ r ]FA n( ' 

For convenience, we will refer to the set of inference rules having the latter form as TZj, 

$, [t]AQi 

i.e. TZt = |Y G TZa I r = -, — m , -, ^ . — for some fluent literal I G J-*}. Now, regarding 

L 1 [t+]1 A -^[t\FA^i ' 

the ramification problem, the basic idea is that the state obtained by updating the previous 
state may not necessarily be stable due to the presence of indirect effects. By representing 
indirect effects as causal rules (using inference rules in our framework) we can reason about 
which causal rules have fired and (relatively) when. Moreover, since these causal rules 
may not take the same amount of time to fire, we should be able to reason about different 
possible orders in which they fire. This will be achieved by a distinction between stable and 
unstable states. 

Definition 6.1 A time-point expression 9 G T£ is stable wrt a given domain description 
D = (£d,H, AB, T) and A C AB iff there does not exist any fluent literal I G T* such that 

1- f + y , } T] f?L G ft/ and T U A h n $, [0}AQ h and 
[T^\l A _, |rj-r A-,i 

2. ruA^ R [9]l. 

Definition 6.2 Let D = (£d, 7Z, AB, F) be a domain description. A set of assumptions A 
is said to be ramification- compliant iff 

1. there does not exist any 5 G AB A q such that Th n (A U {5}) / Th n (A) U {5}. 

2. there does not exist any unstable time-point expression r G T£ such that [r]F^4; G A 
for every I G J 7 *. 

We note that by using unstable time points, we have conceptually isolated the ramifi- 
cation problem from the task of reasoning about the (explicit) actions. 
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Definition 6.3 Let D = (£d, AB, T) be a domain description. A set of assumptions A 
is generally plausible for action domains, or simply AD -plausible, iff 

• A is ramification-compliant, and 

• A is Q-plausible relative to the above condition. 

Remarks: 

1. From the above definition, it can be seen that a solution for the ramification is (in 
a sense) independent from the frame and the qualification problems regarding action 
occurrences. 

2. Given the above temporal ontology, it is worth noting that the traditional notion 
of state constraints may no longer hold in this representation regarding time points. 
More precisely, only states associated with stable time points are subject to these 
constraints. 

6.3 Connection to Causation-Based Formalisms 

The question is, of course, whether the above computational mechanism gives satisfactory 
conclusions for problems in reasoning about action. While many formalisms have been 
proposed, a general criterion for reasoning about action formalisms still seems to be missing. 
The major stream of research towards a solution to the ramification problem is based on the 
notion of causality (e.g., Lin, 1995; McCain & Turner, 1995; Thielscher, 1997). As has been 
discussed above, none of these approaches can deal with domains in which (potentially) 
infinite sequences of indirect effects are present. Most of these approaches (including the 
above three references), however, produce a successor state after the execution of an action 
to capture changes that have taken place either as direct or as indirect effects of that action. 
In this sub-section, we show how our formalism captures the notion of successor states in 
the absence of the infinite sequences of indirect effects. 

Definition 6.4 A domain description D = (Cd,^,AB,T) is non- stratified iff there exist 
two sets $ C A and {h, . . . ,l n } Q J 7 * such that 

1. for each 1 < i < n, U {[r]/j} is ^-consistent, for every r € T£; and 

2. for each 1 < i < n, if k = (i mod n) + 1, then there exists a set C A such that 
$U{[r]/ 8 }h K ^\ and 

[r]AQ lk 
[r+]l fc A -[r]FA^ fc 

Of course, a domain description is stratified if and only if it is not non-stratified. Given a 

def 

domain description D = (Cr,,7l,AB,r), we'll denote .Ed (A) = Th-ji{T\J A), the extension 
of an action theory D according to A. We will also write Ed instead of Ed{%) for brevity. 

Definition 6.5 Let a = (T,F,A) be a signature. 
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1. A set S C T* is an instantwise state iff for every I £ J 7 * , either I G S or ->l G 5. 75 
will be used to denote the set of instantwise states of A, 

2. Let r C F and r € T£ , we denote f = 7 | I G T} and [r]r d = {[r]l \ I G T}, 
5. Let D = 7£, r) be a domain description. D is simplistic iff T = 0. 

The motivation behind the introduction of instantwise states is to allow the reasoner 
to reason about the intermediate states which may not be practically observable to her. 
That is, when indirect effects (following an occurrence of an action or event) take place, 
the world might transit through a number of intermediate states before becoming sta- 
bilised in a final state in which all domain constraints necessarily hold. The ability to 
explicitly reason about such (unstable) intermediate states is one of the advantages of- 
fered by our approach. For instance, let's consider the scenario in Example 1 which 
was originally introduced by Thielscher (1997). Thielscher's (1997) approach allows two 
possible successor states as the results of closing the switch swi in the initial state S = 
{—*swi, SW2, SW3, -^relay, -flight, ^detect}. These are T\ = {swi, -*SW2, sw^, relay, flight, ^detect} 
and T2 = {swi,->sw2,sw3, relay, ->light, detect}. However, to an outside observer who has 
no idea about the tricky internal mechanism of this circuit, it could be quite difficult to 
explain why T2 should be one of the possible outcomes of the action of closing the switch 
swi: starting from an initial state in which detect and light are both off, after performing 
an action toggle(swi), light remains off but somehow detect becomes on. In other words, 
Thielscher's (1997) framework fails to render the intermediate (and unstable) state in which 
light was on, albeit for only a short instant, before it was turned off again. On the other 
hand, such states are explicitly represented and reasoned about as instantwise states in our 
framework. As a consequence, domain constraints do not necessarily hold in an instantwise 
state. 

In the following, we abbreviate simplistic and stratified domain descriptions as SSDs. 
Let Q, C IZj, we denote: 

CONS R (n) -{leT I [T+]lA ^ [T]FA ^ e «}■ 
Similarly, let 17 C TZa, we denote 

coNs A m {i g r 1 '^''y 21 ";^ 1 ^-' g n } . 

V ' X ' [t2]1 A -i[ri]FA_,j 1 

The action description [Ti] ^' } T )\ ^ hll^R^l € n A is applicable in S iff * C S. 

A -[ri]i^L, 

We use to denote the set of action descriptions that is applicable (in S) regarding the 
action a. Q C is a possible application of a in S iff CONS A (Q) is consistent and there 
does not exist any f2' C Tf such that ficfl' and CONSa(Q') is consistent. 

Definition 6.6 Let a = (T,J-,A) be a signature and D = (Cd,1Z,AB,$) a SSD. Suppose 
S G IS and a & A. We formalise the direct effects of an action a using a relation Resn- 
for all S, S' G IS, (S, a, S') G Reso iff there is a possible application f2 of a in S such that: 
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(i) CONS A {n) C S', and 

(ii) there does not exist any instantwise state S" such that S" satisfies (i) and S" \S C 

Definition 6.7 Let a = (T,J-,A) be a signature and D = (Cd,1Z,AB,$) a SSD. The 
causation relation according to D, denoted as Causes £>, is defined as follows: for all S, S' G 
IS, CausesoiS, S') iff there exists a non-empty set ft C TZj of ramification inference rules 
such that 

(i) for each r jff ' ff' £ fi, $ C S and 

(ii) CONS R (Q) C 5', and 

(iii) there does not exist any instantwise state S" such that S" satisfies (i) and (ii) and 
S"\S CS'\S. 

Given a domain description D, a state S G IS is stable regarding D iff there does not 
exist any S' G IS 1 such that Causesn(S, S'). 

Definition 6.8 Let a = (T, J 7 , A) be a signature and D a SSD. Suppose w £ IS and a € .4. 

The state transition from ti; in D according to a, denoted Transf)(w), is the transitive clo- 
sure of CausesD regarding the state uj\ G IS satisfying (w, a,u±) G Resrj- Formally, 
Transput) = {w G IS \ there exists a sequence ui, ... ,u n G IS" such that (w,a,u>i) G 
ResD and w = uj n and G Causesri for each 1 < i < n and is stable regarding Z)}. 

Let I be an interpretation for Cd and t G T, 

• we use [/]* to denote the instantwise state specified by / at time point t: [J]* ^ {/ G 
J 7 * [ 1(1, t) = true}. If [7]* is stable then t is said to be a stable time point in I. 

• we use Ni to denote a function that maps a time point t G T to the next stable time 
point in I: Nj(t) G T such that is stable and for every n G T, if f < u < N t (t) 
then [J] M is not stable. 

Theorem 7 Let a = (T, T , A) be a signature and Dq = (Cr>,TZ, AB, 0) a SSD and a G A,. 
Suppose that w G IS. Define a domain description D = (Cd,1Z,AB,T), where T = {[@]<p | 
if G w}U{[0, + ]q}. A set A C AB of assumptions is AD-plausible wrt D iff for each model 
M of E D (A), [M] Nm ^ G Trans%{[M] @ ), i.e. [M] Nm ^ belongs to the state transition 
from [M] e in D according to a. 

We now re-consider the motivating examples introduced in Section 1.3. 

Example 1 (continued.) We re- formulate the action theory for this example in terms of 
our formalism: 
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[t]swi, [t]sw 2 , [T]AQiig ht 
[T+]light A -\t]F 'Alight' 

^[rjswi, [t]AQ ^i ight 
^[T+]lightA^[T]FA light 

[r]relay, [t]AQ^ SW2 



(* = 1, 2), 



->[r]swj, [r, v]togglej 
[vjswi A ->[T]FA-, SWi 
[t](,[t]FA c 



= 1,2,3), 



1C 



, where ( € T* . 



[t]sw!, [t]sw 3 , [T]AQ relay 
[r+]relay A -^[T]FA^ relay ' 

^[T]sWj, [T}AQ^ re i a y 

-i[T+]relay A ^[T]FA relay 

[flight, [r]AQ detect 
[t+ } detect A ^[t]F A^ detect ' 



= 1,3), 



[t\svh, [t, v\togglej 
^[v]swi A ->[t]FA su 



■(» = 1,2,3), 



The theory is described as follows: 



T = {-,[Q]swi, [@}sw 2 , [@}sw 3 , ^[e\relay, ^{<d]light, -i[Q\detect} U {[9, N {®)}togglei} . 

Consider A such that A AQ = AB AQ \{[Q 2+ ]AQ detect , [0 3+ }AQ detect } and A FA = AB FA \ 
{[e + }FA^ light ,[e + ]FA^ relay ,[e 2+ ]FA SW2 ,[e 3+ }FA light }. A is AD-plausible resulting in 
the next stable state being u> = {swi, ->SW2, sw 3 , relay, ->light, ^detect} at [G 4+ ]. 



In addition, the set A' C AB, where A' AQ = AB AQ \ {[@ 2+ }AQ detect } and A' FA = 
AB FA \ {[e+]F^ M ,[e+]F^ re ^,[e 2+ ]F^ 2 ,[e 3+ ]F^ t , [® 3+ }FA^ detect \, is also 
AD-plausible which results to the next stable state to' = {sw\, ->SW2, sw 3 , relay, ->light, detect} 
at [0 4+ ]. 

Moreover, the set A" C AB, where A" AQ = AB AQ and A FA = AB FA \{[N(Q)]FA^ Hght , 
[& + ]FA^ re i ay ,[e 2+ ]FA SW2 ,[e 2+ ]FA^ detect ,[e 3+ ]FAi ight }, is also AD-plausible which also 
results to the next stable state u' at [0 4+ ]. In other words, the model implied by A' reflects 
a domain in which it takes the same amount of time for the detect to be on and the switch 
SW2 to jump off. On the other hand, the model implied by A" reflects a domain in which 
the amount of time for the detect to be on is (approximately) equal to the amount of time 
for switch SW2 to jump off and cause the light to be off as well. The detect implied by A is 
so insensitive that even though the light and the relay are on at the same time (0 2+ ), the 
relay causes switch SW2 to jump off and then leads to the light to be off as well but the 
detect is yet on. 



Example 2 (continued.) We re- formulate the action theory for this example in terms of 
our formalism: 
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[r}upL 1 , [T]upL 2 , [r}AQ open 
[r + ]open A ^[T]FA^ open 
[t, v]flipi,^[r}upL 



(* = 1,2), 



[v]u P Li A -[r]FA^ pLi 
[ri,T2}hold_closed,—i[Ti]open,Ti < r < T2 
[rjheld-closed A -i[r]F^^ e id dosed 



[r, v}flipi, [r]upLj 
-^[v]upLi A -^[r]Fi lipi! 
[r, ujc/ose, [rJupLi, [r]upL 2 
-i[u]open A -.[r]Fvl p e „ 



(* = 1,2), 



[r]AQ. 



open. 



-, where ( G .T 7 *. 



[r+]C 

The theory is described as follows: 

r = {[Q]upLi, [Q]upL 2 , [@]open, [@]^held_closed}U{[ci,C2]close, [02, c^hold-closed, [cA,c^\flip 
{B < ci < c 2 < c 4 < c 5 < c 3 }. 

Consider A C such that Aaq = ABaq \ {[c]AQ open I c 2 < c < C3} and A^ = 
^FA\({[ci]-F^ ope „}U{[c]FA^ eM _ dose(i | c 2 < c < c 3 }U{[c 4 ]FA„p Ll }). A is AD-plausible 
and resulting in the following: 



[c\]{upLi, upL 2 , open, ^held-dosed}, 
[c 2 ]{upLi, upL 2 , -^open, held_closed} , 
[c4]{upLi,upL 2 , -^open, held-closed} , 
[c5]{->upLi,upL2, ^open, held-dosed}, 
[c3]{->upLi, upL 2 , ^open, held-dosed}. 



Example 3 (continued.) The domain description: 



[t]sw!, [t]sw 2 , [T]AQ re i ayi 

[r + ]relayi A -{t\F A^ retayi ' 
[r]relayi, [t]AQ^ SW2 



t+]sw 2 A^[t]FA SW2 ' 
rjswi, [t, vjtogglei 



swi A ->[t]FA-, 
C, [t]FA c 



1,2), 



1C 



, where ( € T* 



[t]sw!, ^[t]sw 2 , [r]AQ re i ay2 

[r+]relay 2 A -<[t]F 'A^ re i ay2 ' 
[T]relay 2 , [t]AQ SW2 

[t + ]sw 2 A -i[t]FA-, SW2 ' 
[rjawj, [T,v\togglei =X2 \ 
^[v]s Wi A^[T]FA sw } 1 ' j ' 



The state of the circuit in Figure 2 is captured by the following action theory: 

r = {-.[ejs^i, [Q]sw 2 ,-'[®]relay 1 ,->[@]relay2}U{[c 1 ,C2]toggle 1 , [c 3 , c^toggle^U {& < c x < 
c 2 < c 3 < c 4 } 

Consider A C AB such that A^q = ABaq and A F a = ABfa \ ({{ci]FA^ SWl } U 
{[c3]FA SU)1 } U {[c]FA^ re i ayi I c 2 < c < c 3 and c = (c2) fc+ where k = 4i and i = 0, 1, 2, . . .}U 
{[c]FA SW2 , [c]FA re i ayi I C2 < c < C3 and c = (c2) fc+ where k = 4i + 1 and i = 0, 1, 2, . . .}U 
{[c]F^4_, re ^ ay2 I C2 < c < C3 and c = (c 2 ) k+ where k = Ai + 2 and i = 0, 1, 2, . . .}U 
{[c]F^4^ su , 2 , [c]FA re i ay2 I C2 < c < C3 and c = (c2) fe+ where /c = M + 3 and i = 0, 1,2, . . .}). 
A is AD-plausible resulting to several possible models for this domain depending on when 
switch sw\ is toggled off: 

[ci]{-iswi, SW2, -irelayi, ^relay 2 }, 
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[c 2 ]{swi,sw 2 , -irelayi, ~^relay 2 }, 
[c 3 ]{sw 1 ,±sw 2 , Trelayi, ±relay 2 }, 
[c 4 ]{^swi, ±sw 2 , Trelayi, ±relay 2 }. 

Remark: 20 

Here, it is also important to raise the question whether our solution to the ramification 
problem conflicts with the formulation of concurrent actions. When two actions ct\ and a 2 
are concurrently performed: a± causes an indirect effect E and a 2 triggers a non-terminating 
chains of effects. If the direct and indirect effects caused by a 2 don't interfere with a±s 
production of E then the reasoner can reason about time points after the execution of a± 
where E holds for being an indirect effect of a\. These time points are of course unstable 
due to the non-terminating chains of indirect effects caused by a 2 . On the other hand, 
if the direct and indirect effects caused by a 2 have the potential to prevent the former 
from producing E, the reasoning could be more complex. If it is observable that the direct 
effects of both actions take place at the same time then the concurrent occurrences of the two 
actions can be viewed as one single occurrence of one complex actions whose direct effects are 
a combination of the direct effects of the two actions. Further reasoning about ramifications 
will then be carried out as usual. On the other hand, when the reasoner herself is unsure 
about the temporal correlation between the direct effects of the two actions, every possible 
order of changes must be taken into consideration leading to a highly nondeterministic 
outcome about what fluent will hold in the future time points. However, such a situation 
can still be handled nicely by our formalisation. The only representation issue which is 
not addressed by our framework is about indirect effects with duration. As asserted above, 
given the state of the world at a time point r, we assume that all subsequent indirect 
effects will take place at the next time point r + . This certainly fails to deal properly with 
indirect effects whose durations are different. A simple solution to this problem can be to 
associate one next time point operator for each possible indirect effect. This, however, will 
significantly complicate the representation. 

7. Discussion and Future Work 

We developed a uniform framework for reasoning about action using an argumentation- 
theoretic approach (more precisely, assumption-based approach). We have also presented 
how our framework copes with the frame, the qualification and the ramification problems in 
several sophisticated settings. We have shown how our framework can be naturally extended 
to become more expressive. 

We also explored a new abstraction level which we believe to be an intermediate layer 
between the common sense knowledge and the scientific knowledge. Sophisticated domain 
knowledge as well as representation are, we argue, required to achieve an adequate underly- 
ing representation and reasoning process. Among the merits of this approach, we emphasise 
the following: 

• Non-monotonicity is handled by assumptions and argumentation-theoretic approach. 
20. The authors would like to acknowledge an anonymous referee for pointing out this very subtle issue. 
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• The flexibility of working with different kinds of information representation since there 
is no restriction on the syntax of the system. 

• Expressivity: temporal information is explicitly represented. Thus the system is ca- 
pable of capturing many important features of temporal reasoning. 

As reviewed in the introductory section of this paper, numerous approaches to reasoning 
about action have been proposed. As such, much research related to these approaches and 
frameworks has evolved around the central problems addressed in this paper, namely the 
frame, qualification and the ramification problems. However, as non-monotonic reasoning- 
based formalisms for reasoning about actions were shown to be flawed by Hanks and McDer- 
mott (1987), many existing solutions of the frame problem are based on other approaches 
which are usually monotonic. Since one of the inherent properties of the argumentation- 
theoretic approach is monotonicity, few have attempted to solve the problems of reasoning 
about actions using this approach. 

A framework for reasoning about actions under the argumentation-theoretic approach is 
independently proposed by Kakas, Miller, and Toni (1999, 2000, 2001). In their approach, 
the admissibility semantics is also employed to resolve conflicts between adversary argu- 
ments. To represent common sense knowledge, e.g. the common sense law of inertia, an 
order is imposed on the set of inference rules of the assumption-based framework. The com- 
putation of the arguments and their competing is performed on top of the so-called proof 
trees. Nodes on the proof trees are arguments which are sets of propositions. 21 Construc- 
tion of proof trees is on the same level of hardness as known frameworks for argumentation- 
theoretic computation. While their framework allows the persistence of (inertial) fluents to 
be captured and dealt with, it is not very clear whether their formalisation can be extended 
to deal with other problems of reasoning about actions such as the qualification and the 
ramification problems. 

More recently, Dimopoulos, Kakas, and Michael (2004), and Bracciali and Kakas (2004) 
extended Kakas et al.'s framework to deal with the ramification and the qualification prob- 
lems. Essentially, in their solution to the ramification problem, the so-called r-propositions 
of the following form: 22 

L whenever C 

are added to the domain description. A resulting model for a given domain description will 
then be computed by first computing all possible indirect effects as the fixed point of re- 
peated application of r-propositions, and then completing the model by allowing unaffected 
fluent literals to persist over time. It should be clear that the above representation of indi- 
rect effects is quite restrictive as it doesn't allow more complex expressions for the conditions 
of an indirect effects and the indirect effects themselves. These restriction is essentially due 
to their use of Answer Set Programming (ASP) as the underlying computation mechanism 
of their framework. On the other hand, their solution to the qualification problem lies in the 
use of default rules for representing the effects of actions. This approach is fairly similar to 

21. In Kakas et al.'s (1999, 2000) terminologies, each node is a set of arguments which is equivalent to the 
notion of arguments in our exposition. 

22. L is a fluent literal and C is a set of fluent literals which is essentially equivalent to a conjunction of 
fluent literals. 
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Thielscher's (2001) solution to the qualification problem discussed above. As their approach 
is essentially based on stability semantics, it's not clear how the argumentation-theoretic 
approach will bring about any benefit to their framework. 

As discussed earlier in the paper, the key insight behind the solutions implemented in 
our framework is the exploitation of causality to drive the inference. It is causality that has 
helped throughout in our solutions to the frame and the qualification problems to provide 
the mechanisms to eliminate the anomalous models while retaining the intuitive models 
during the process of reasoning. This insight is certainly a more general version of the con- 
clusions derived by Sandewall (1994) when investigating the reason behind the production 
of anomalous models in early approaches to the frame problem, namely the failure to dis- 
tinguish between normal changes which are triggered by actions and abnomalous changes. 
Sandewall's insight has certainly originated the occlusion-based solution to the frame prob- 
lem (Sandewall, 1994; Doherty, 1994; Gustafsson & Doherty, 1996). Roughly speaking, in 
this approach each action type is associated with a subset of fluents that are influenced 
by the action. Also, a predicate Occlude is introduced to allow this subset of fluents to 
be specified. When reasoning about dynamic domains, changes are minimised with the 
exception of the fluents specified by Occlude. In other words, Occlude distinguishes the 
normal changes (associated with the action types) from the anomalous changes and thus 
avoids unintended models from arising. 

Regarding the qualification problem, Thielscher's (2001) solution to the problem of 
anomalous models in relation to the qualification problem shares the key insight of causality 
with our approach. However, Thielscher's framework is based on the standard semantics 
of Default Logic (with the initial theories are generated using circumscription). Thus, his 
approach does not deal with problem domains where standard semantics of Default Logic 
does not produce an extension. Furthermore, as discussed in the introductory section of our 
paper, in Thielscher's framework qualifications are taken over the executability conditions 
for the actions instead of over different effects of the actions. 

In parallel to the causality-based insight to dynamic domains, other mechanisms for 
solving various problems of reasoning about action exist. For instance, a number of ap- 
proaches employ the concept of chronological ignorance (Shoham, 1987, 1988) to tackle 
the problem of anomalous models. In general, causality-based frameworks and approaches 
based on chronological ignorance share the notion of directedness: when changes are min- 
imised chronologically, causes are minimised instead of effects as causes are likely to precede 
effects. However, as a consequence, backward reasoning is blocked which prevents chrono- 
logical ignorance-based approaches from dealing with surprises and expectation failures. 
Furthermore, non-deterministic actions or incomplete state knowledge are known to cause 
difficulty to chronological minimization. For a more detailed comparison between causality- 
based approaches and their counterparts that are based on chronological ignorance, the 
reader is referred to an article by Thielscher (2001). On the other hand, approaches that 
are based on Motivated Action Theory (MAT) (Amsterdam, 1991; Stein & Morgenstern, 
1994) can be considered as a special case of the causality-based paradigm. MAT frame- 
works also advocate for the insight that an appropriate notion of causality is necessary when 
assuming away abnormalities. MAT frameworks, however, don't cope very well with the 
explanation problem and the ramification problem as pointed out by Jr. (1999) who also 
introduce an approach to improve MAT and overcome these problems. 
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Nonetheless, several issues still remain within our framework and will need further treat- 
ment to achieve an optimal solution. Firstly, this formalism may not be very suitable for 
the large-scale problems as too many assumptions will need to be taken into account. To 
address this problem, a localisation procedure is invented to guarantee that only an ade- 
quate sub-language will be used to capture the circumstance the agent is reasoning about. 
As a consequence, the set of assumptions will be restricted to those which are necessary to 
infer the conclusions the agent is interested. This idea is under development. Furthermore, 
while a uniform solution to all major problems of reasoning about action may be quite 
attractive especially regarding the toy scenarios such as those considered in this paper as 
well as in the literature, such a solution may not be pragmatic. By considering the locality 
account of reasoning, in particular of the assumptions used in default reasoning, promising 
solution can be achieved from both computational and representational points of view. We 
are undertaking further investigation towards this research direction. 

A major limitation of our framework is the ability to deal with disjunctive axiomati- 
sation of action occurrences. For instance, when the domain axiomatisation constains a 
disjunction about the action occurrences such as [ti,i2]ai V [ii,t2]a2, then no plausible sets 
of assumptions, and accordingly, no CPMMs (resp. CPMQMs) will be produced to account 
for the effects of these actions. While an initial formalisation of our framework allowed 
complex expressions for action occurrences in the premises of inference rules which over- 
came this problem, the formalisation appeared to be too complex and some of the technical 
results could not be established. Further investigation, therefore, is needed to overcome 
this problem while avoiding to produce an overly complex formalisation. 

Provided that our formalism has been designed to provide a general framework for rea- 
soning about action, the following comes as a natural question: To what extent the proposed 
approach can be used to formalise dynamic domains? Sandewall (1994) suggests that one 
should systematise a framework for reasoning about action against some standard criteria 
to provide the formal indications about the expressiveness and capacity of a formalism. 
This is in contrast to the more traditional approach that had prevailed for many years in 
reasoning about action in which one tries to come up with some examples to show that no 
existing approaches are able to deal with such a scenario and claims that one's approach is 
better than others in which it can solve the proposed scenario. 

Relative to Sandewall's standard criteria, our approach enjoys the following properties: 

1. Our approach is non- inertia as it allows observations about the later state to cor- 
rect the system's predictions about those states using some explanation mechanism 
through the use of assumptions. 

2. Our formalism is able to deal with non-deterministic and concurrent events. 

Another issue is the abduction problem which is also known in the literature as the 
explanation problem. For example, in the Stolen car scenario, by observing that the car 
disappeared from the parking lot where the reasoner had left it, an expectation failure arises. 
Most formalisms would try to accommodate this problem by introducing a stealing action 
as part of the vocabulary and try to bind the disappearance of the car to this action. This 
arguably is not very intuitive as there is no good reason why we should include this action 
in the vocabulary in the first place but not others such as the car being towed away by the 
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police or a fairy turning the car into a pumpkin, etc. From a pragmatic point of view, some 
reasoners may just simply acquire more information (perhaps from the police) instead of 
confusing themselves with all kinds of explanations towards possible but uncertain causes. 
In other words, we effectively isolate the issues of deducing the new conclusions from the 
existing knowledge base from abducing the possible causes of some observations. This is 
of course closely related to Shanahan's approach in his IJCAI'95 paper (Shanahan, 1989) 
whose title clearly indicated that "Prediction is Deduction but Explanation is Abduction" . 
We are also working on an assumption-based framework to solve the abduction problem. 
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Appendix A 

Theorem 1 Let D = (C D ,TZ,AB,T) be an S-domain. If I is a CPMM of D then A QF is 
plausible. 

Proof: Suppose that J is a CPMM of D, 

(i) we prove that Aq F is presumable: 

Aq F is ^.-consistent since / is a model of D. From Observation 2, we have Aq F is 
closed and does not attack itself. From Lemma 1, for each assumption 5 E AB, if S ^ ^-qf 
then 6 is rejected by Aq F . 

(ii) we prove that Lr(Ag F ) is minimal: 

Suppose by way of contradiction that there exists a presumable set of assumptions A 
(wrt D) such that Lr(A) C Lr{Aq F ). Let be the A-relativised model of D. It is obvious 
that /a is coherent. We will derive a contradiction by proving that Occ Ia C Occ 1 : 

(11.1) OA D C Occ 1 : obvious as OA D = {(<f>(n), a, 0(r 2 )) G T x i x T | T ^ [n,T 2 ]a}, 
and / is a model of D. 

(11.2) DAS (A) C Occ 1 : Let (t,da^i,t + ) E DAS (A), then there do not exist any action 
a E Ao and s E T such that 

<S>,[T 1 ,T 2 }a,[T 1 ,T 2 }AQ^ 
-W A ^[t 1 ]FA 1 

and / |= prem(r)[Ti/s, T 2 /t + ]}. Thus, the assumption 5 = [t]FA[ E Lr(A). Thus, 8 E 
Lr(Aqp) (from the hypothesis.) From Lemma 2, I \= [t,t + ]da^i. Thus (t,da~,i,t + ) E Occ 1 . 

(11.3) Occ 1 <l Occ Ia : Let 6 = [t]FA t E Lr{A QF ) \ Lr(A) for some t E T and I E J 7 *. 
Since J is a CPMM of D, from Lemma 2, I \= [t, t+]da^. Thus (t, da^i,t + ) E Occ 1 . 
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Moreover, 5 £ Lr(A) iff either (a) 5 G A, or (b) there is a € Aq such that 

r = *' e ft and TU A <$>[T 1 /t,T 2 /t + ], [t,t+]a, [t,t+]AQ^ 

iff, following the construction of A-relativised models, Ia ty= [t, t + ]da^i. Thus (t, da^i,t + ) 
Occ Ia . Therefore, Occ Ia C Occ 1 . 

Hence, Lr(Ag F ) is minimal and Aq F is plausible. □ 



Theorem 2 Let D = {Cd, AB, T) be an S-domain and A C AB. A is plausible wrt D 
iffMod 6 A {D) / and for each I G Mod s A {D), I is a CPMM ofD. 

Proof: 

(=>) Suppose that A C AB is plausible wrt D. Then TuA is 7£-consistent, i.e. TU A \/n 
false. From the construction of A-relativised models, Mod A (D) ^ 0. 

For each / = (h, <j), i], e q , £/} G Mod A (D), we prove that / is a CPMM of D. 

(i) I is a coherent S-model of D: obvious from the definition of A-relativised models. 

(ii) Occ 1 is minimal: 

Assume the contrary, i.e. there is a non-empty set Mi = { J | J is a coherent S-model 
of D and Occ J C Occ 1 }. Let H G Mi such that there does not exist any model J G Mi 
and FA H C FA J . 

Consider the set of assumptions Aq F : 

(ii.a) Aq F is presumable wrt D: 

• Aq F is closed and does not attack itself (since H is a model of D); 

• Let 5 G AB, if 5 = [t]FAi g" Aq F (for some r G T£ and / G F*) and (5 isn't rejected by 
Aq F then we can easily construct a model J that interprets everything except FA the 
same as H and FA J = FA H U {(0(r), FA;)}. Obviously, J e Mi and FA J C FA H 
which is a contradiction. Thus S is rejected by Aq F . 

Therefore, Aq F is presumable, 
(ii.b) Lr{Aq F ) C Lr(A): 
Occ 77 C Occ 1 since H £ Mi. 

Let (5 G Lr(A^ F ). Since ,48 aq C A^ f , 5 = [i]_FAj G AB FA for some t G T and 
I G F*. From the definition of leniently rejected assumptions, T U Ag F 1/^ false but 
T U Aq F U {(5} false. But then, from the definition of coherent models, H \= [t, t + \da^i 
(since H is a coherent model of D). Thus, / |= [t, t + ]da^i. 

From the construction of A-relativised models, [t]F.Aj G" A. Thus, 5 is rejected by A 
(since A is plausible wrt D). Also from the construction of A-relativised models, T U A \fn 
->S. Therefore, S G Lr(A), or Lr(A% F ) C Lr(A). Now, Occ 7 = OA D U DAS(A). OA D C 
Occ 77 since if is a model of D. Thus, Occ 7 \ Occ 77 = DAS (A) \ Occ 11 . Let (t,da^,t + ) G 
DAS (A) \ Occ H . From the construction of A-relativised models, 5 = [t]FAi G Lr(A). 

Suppose further that 5 G Lr(Ag^). Then, (5 ^ A^p (as A^p is presumable). We 
construct a model J in such a way that J interprets everything except FA the same as H. 
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From the definition of coherent models, (t, da^i, t + ) £ Occ H iff either (1) H \£ [t]l A - '[t + ]Z; 
or (2) there is a G Aq, and 

<S>,[T 1 ,T 2 }a,[Ti,T 2 }AQ^ 
-[r 2 ]Z A ^[t 1 ]FA 1 

and T U A |= prem(r)[T 1 /t,T 2 /t + ], i.e., r U A |= ^[n/t, T 2 /t + ], [t,t + ]a, [t,t + ]AQ^. Since 
5 = [t]FAi G Lr(A), condition (2) can not be satisfied. 

Thus, (t,da^i,t + ) ^ Occ H iff H \/= [t]l A In other words, it is consistent to add 

the assumption [t]-FVb, to the set of assumptions Ag F . Or, from a model-theoretic point of 
view, to augment the denotation of FA in H with (t, FA{) and we can still obtain a coherent 
S-model J such that FA H C FA J . But this is a contradiction. Hence, 5 Lv(Aq F ). 

We have shown that Lr(Ag F ) C Lr(A). 

From (ii.a) and (ii.b) we are led to the conclusion that Occ 1 is minimal. As a conse- 
quence, I is a CPMM of D (from (i) and (ii)). 

(«*=) Suppose that Mod s A {D) ^ and for each I G Mod^(D), J is a CPMM of D. 
We prove that A is plausible wrt D. Take an arbitrary model I G Mod A (D). Following 
Observation 4, A = Aq F . From Theorem 1 and the hypothesis that / is a CPMM of D, 
we conclude that A is plausible wrt D. □ 



Theorem 3 Let D = (£d,1Z, AB, Y) be an S-domain. Furthermore, suppose that CPMM(D) 
is the set of CPMMs of D and Plaus(D) is the set of plausible sets of assumptions of D, 
thenCPMM(D) = l) AePlaus(D) Mod s A (D). 

Proof: 

Q) Let A G Plaus(D), then Mod s A {D) C CPMM(D) (Following Theorem 2). There- 
fore, l) AePlaus{D) Mod s A (D) C CPMM(D). 

(C) Let / G CPMM(D), then A^ F G Plaus(D) (Following Theorem 1). 
We prove that I G Mod A i^(D) based on Definition 5.4: 

1) I is an S-model of D, 

2) for each S = [t]FAi G AB fa (for some r G T£ and Z G J 7 *), 5 G A^ F iff (0(r), FAj) G 
F^4 7 (Following the definition of Aq F - Definition 5.3) 

3) We prove that Occ 1 = OA D U L>AS"(A^ F ): 
(3-5) 

• = {(^(n),a,^(r 2 )) G T x„4 xT | T |= [ri,r 2 ]a} C Occ 7 (as J is a model of D), 

• {t,da^i,t+) eDAS(A T QF ). 
From Definition 5.4, 

(i) 5 = [t]FAi $ A ! QF , and 

(ii) there exists no action a G Ao such that: 

= $,[n,r 2 ]«, [ri,r 2 ]^Q^ 
r -[r 2 ]/A-[n]FA 
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and T U A |= $[n/t, T 2 /t+], [t, t+]a, [t, t + ]AQ^. 

From Lemma 1, S £ Aq F iff 5 is rejected by Aq F iff — as 7 is a coherent model - 
either (a) there are a G *4o and s£T such that 

= ^,[ri,r 2 ]«, [t 1 ,t 2 ]AQ^i 
-,[t 2 }1 f\^[r l ]FA l 

and 7 |= prem(r)[Ti/s, r 2 /t + ], 
or (b) 7 \= [t,t + ]da^. 

Since (a) violates condition (ii) above, (b) must be the case. Thus (t, da^i, t + ) G Occ 1 . 
7)AS(A 7 F ) C Occ 7 . 

=> Occ 7 3 0if)U DA5(Aj F ). 

(3.C) Suppose that Occ 7 % OA D U DA5(A^ F ). From (3.D), we have Occ 7 D OAd U 
DAS(Aq F ). Since Ag F is plausible, there exists a model J G Mod^j (D) such that J 

is a CPMM of 79. Following Definition 5.4, Occ J = OA D U DAS(A 1 QF ) which is a proper 
subset of Occ 7 . Contradiction! Therefore, Occ 7 C Oi D UMS(A^ F ). 
Thus we have shown that 7 G Mod^j (T>), 

M G UA e Piau,(D) Mod| (79) (Since A 7 F G Plaus(D)) 
=> CPMM(D) C U Ae «a US (D) Mod£(Z>). 

Therefore, CPMM(D) = U Ae p ia!ls(B) Modi(D). □ 



Theorem 4 7e£ D be a Q-domain. If I is a CPMQM of D then Aq F is Q-plausible wrt 
D. 

Proof: 

Suppose that 7 is a CPMQM of D, 

(i) it's easy to verify that Aq F is semi-Q-plausible wrt D: similar to the proof of theorem 
1, but using Lemma 3 instead of Lemma 1 and Lemma 2. 

(ii) A A q is maximal: 

Assume the contrary, i.e. there exists a set of assumptions A such that A is semi-Q- 
plausible wrt D and A A q C Aaq- Since A is presumable, T U A is ^-consistent. Let 7a be 
the A-relativised model of D. Obviously, 7a is a coherent Q-model of D. It's easy to verify 
that Occ 7a is minimal because otherwise a coherent Q-model J (of D) can be constructed 
such that Occ 1 C Occ 7a . We have Occ 7a = OA D U DAS(A) and OA D C Occ 1 since J is a 
model of D. Thus there exists (i, da-,^, t + ) G DAS (A) \Occ J . But then Aq F is presumable 
wrt D and Lr{Aq F ) C Lr(A) which is a contradiction. Thus, Occ 7a is minimal. But then 
the model 7a is a PMQM of D and AQ Ia C AQ 7 which contradicts with the fact that 7 is 
a CPMQM of D. Therefore, A AQ is maximal. 

(iii) A FA is maximal (relative to (i) and (ii)): 

Assume the contrary, i.e. there exists a set of assumptions A such that A is semi-Q- 
plausible wrt D and Aaq is maximal and A FA C Afa- Let 7a be the A-relativised model 
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of D. Similar to the proof in part (ii), we can easily verify that Ia is a PMQM of D. As the 
fact that A.aq is maximal and A FA C Afa contradicts with the given hypothesis that / is 
a CPMQM of D, we conclude that A FA is maximal. Therefore, Aq F is Q-plausible wrt D. □ 

Theorem 5 Let D = (Cd, ft, AB, T) be a Q-domain and A C AB. A is Q-plausible wrt D 
iffMod%(D) / and for each I G Mod%(D), I is a CPMQM of D . 

Proof: 

(=>) Suppose that A is Q-plausible wrt D. 

As A is presumable, T U A is ^-consistent. Following the construction of A-relativised 
models, Mod^D) / 0. 
Let / G Mod%{Dy. 

(i) it's easy to verify that / is coherent from the construction of A-relativised models. 

(ii) Occ 1 is minimal: 

Assume the contrary, i.e. the set = {a | a is a coherent Q-model of D and Occ a C 
Occ 1 } is non-empty. 

Let J G X/ such that the following conditions are satisfied: 

1. there does not exist any model a G such that Occ a C Occ J . 

2. AQ J is maximal relative to 1. 

3. FA J is maximal relative to 1. and 2. 

Consider the set of assumptions Aq F : Obviously, Aq F is closed and does not attach 
itself. For each 5 G AB, if S £ A^ F then 5 is rejected by Aq F , otherwise it would violate 
the maximality of A^q and A Fyl . Thus, Aq F is presumable. 

Remark that Occ J C Occ 1 . Besides, Occ 1 = OA D U DAS (A). But OA D C Occ J as 
J is a model of D. Thus there exists (t, da^,t + ) G DAS(A) \ Occ J . But then Aq F is 
presumable wrt D and Lr(A J Q F ) C Lr(A) which is a contradiction. Thus, Occ 1 is minimal. 
As a consequence, / is a PMQM of D. 

(iii) AQ 1 is maximal (relative to (i) and (ii)): 

Assume the contrary, i.e. the set = {a \ a is a PMQM of D and ^Q 7 C ^IQ' 7 } is 
non-empty. 

Let J G S/ such that the following conditions are satisfied: 

1. FA J is maximal; and 

2. AQ J is maximal relative to 1. 

We can prove that that Aq F is semi-Q-plausible (i.e. presumable wrt D and LrFA{Aq F ) 
is minimal): 

That Aq F is presumable wrt D is easy to verify. 

It's also easy to verify that LrFA(A'Q F ) is minimal as J is coherent and Occ J is minimal. 
This would guarantee that the set of occurrences of dummy actions in J is minimised and as 
a consequence the set of leniently rejected frame assumptions is also minimised. Formally, 
if a presumable set of assumptions n is such that LrpA^) C LrpA{Aq F ) then the A- 
relativised model In is a coherent Q-model and Occ In C Occ J , which is a contradiction 
with the fact that J G T,j and thus J is a PMQM of D. 

Thus, Aq F is semi-Q-plausible wrt D. But, Aaq C A j A q which is a contradiction. 

Therefore, we have shown that AQ 1 is maximal (relative to (i) and (ii)). 
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(iv) Now, we can prove that FA 1 is maximal (relative to (i), (ii) and (iii)): 
Assume the contrary, i.e. there exists a PMQM J of D such that FA 1 C FA J . 
Among those models satisfying the above condition, we choose a model K such that 

there does not exist any PMQM K' of D such that FA K C FA K ' . Thus, K is a CPMQM 

of D. 

Following Theorem 4, we have the set of assumptions Aq F is Q-plausible and Afa C 
Ap A since FA 1 C FA K . Contradiction with the hypothesis that A is Q-plausible. 

From (i), (ii), (iii) and (iv) we are led to the conclusion that / is a canonical prioritised 
minimal Q-model of D. 

(<^=) Suppose that Mod^(D) / and / is a canonical prioritised minimal model of D 
for each / G Mod^D), we prove that A is plausible. 

Take an arbitrary model I G Mod^(D). Following Observation 5, A = Aq F . From 
Theorem 4 and the hypothesis that / is a canonical prioritised minimal Q-model of D, we 
conclude that A is Q-plausible. □ 



Theorem 6 Let D be a Q-domain. Furthermore, suppose that CPMQM(D) is the set of 
CPMQMs of D and Plaus^(D) is the set of Q-plausible sets of assumptions of D, then 
CPMQM(D) = U AePlausQ{D) Mod ( i(D). 

Proof: Similar to the proof of Theorem 3. □ 



Theorem 7 Let a = (T, J 7 , A) be a signature and Dq = {Cr>,TZ, AB, 0} a SSD and a G Ao. 
Suppose that w G LS. Define a domain description D = (Crj,7Z,AB,T), where T = {[@]<p \ 
if G u;}U{[0, + ]a}. A set A C AB of assumptions is AD-plausible wrt D iff for each model 
M of E D (A), [M] Nm ^ G Trans a D {[M] e ), i.e. [M] Nm ^ belongs to the state transition 
from [M] e in D according to a. 

Proof: 

(=^) Suppose that A C AB is AD-plausible wrt D, we prove that for each model M of 
E D (A), [M] n m^ G Trans^M] ). 

Let M G Mod(E D (A)), as M \= T, we have M \= [@]<p iff <p G w. Thus w = [M] e . 

We prove that [M] Nm ^ G Transf)(w), i.e. there exists a sequence lo± , . . . , u n G IS such 
that (w,a,uJi) G Resr> and [M] Nm ^ = uj n and (w^u^+i) G Causesn for each 1 < i < n. 

If = 0: to the reasoner's knowledge, a is not applicable in the instantwise state w 
due to either non-executability of a in w, or a does not bring about any effects concerned 
to the reasoner. Thus, [M] e = w. Of course, (w,a, [M] @ ) G Reso- 

If 7^ 0: let f2 = {r G TZa | M \= prem(r) and M \= cons(r)}, we prove that f2 is a 
possible application of a in w. 

Apparently, 0, C T™. 0, is maximal since otherwise we can construct a model M' such 
that M' satisfies the qualification assumption of the additional action description rule. But 
it means M' is a PMQM model of D such that AQ M C AQ M ' . Thus M is not a CPMQM 
of D. Following Theorem 5, A is not Q-plausible wrt D. Contradiction. 

We now prove that there does not exists any instantwise state S such that CONSa(Q) Q 
S and [M] @+ \ w C S\w. 
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Assume the contrary, i.e. there exists a fluent literal tp G J 7 * such that ip G (S \w)\ 
([M] e+ \w). 

Then M ^ [&\FA V since M is a model of D. 

Construct a model M' in such a way that M' interprets everything the same as M except 
FA, and FA M ' = FA M U {(0, FA^)}. Obviously, M' is a PMQM of D and AQ M ' = AQ M , 
but F,4 M C F,4 M '. Thus M is not a CPMQM of D. Following Theorem 5, A is not 
Q-plausible wrt D. Contradiction. Therefore, (w,a, [M] e+ ) G Reso- 

(<J=) Suppose that for each model M of E D (A), [M] Nm ^ G Trans%{[M] e ), we prove 
that A C AB is AD-plausible wrt D which is obvious. □ 
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